-- Logs begin at Fri 2021-11-19 18:46:47 UTC, end at Fri 2021-11-19 20:39:50 UTC. -- Nov 19 19:17:19.222514 dv-cinder-777031-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 19:17:19.231573 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 19:17:19 2021] *** Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: nodename: dv-cinder-777031-13-iscsi Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: machine: x86_64 Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: clock source: unix Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: pcre jit disabled Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: detected number of CPU cores: 4 Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: current working directory: / Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: detected binary path: /usr/bin/uwsgi-core Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: your processes number limit is 47680 Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: your memory page size is 4096 bytes Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: detected max file descriptor number: 2048 Nov 19 19:17:19.233679 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: lock engine: pthread robust mutexes Nov 19 19:17:19.234628 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: thunder lock: enabled Nov 19 19:17:19.234628 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 19:17:19.234628 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 19:17:19.279229 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: Python main interpreter initialized at 0x556d68a1e9c0 Nov 19 19:17:19.279229 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: python threads support enabled Nov 19 19:17:19.279229 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: your server socket listen backlog is limited to 100 connections Nov 19 19:17:19.279229 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: your mercy for graceful operations on workers is 90 seconds Nov 19 19:17:19.279620 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 19:17:19.279698 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: *** Operational MODE: preforking *** Nov 19 19:17:19.279964 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: *** uWSGI is running in multiple interpreter mode *** Nov 19 19:17:19.279964 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: spawned uWSGI master process (pid: 101863) Nov 19 19:17:19.280182 dv-cinder-777031-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 19:17:19.281524 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: spawned uWSGI worker 1 (pid: 101864, cores: 1) Nov 19 19:17:19.281524 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: spawned uWSGI worker 2 (pid: 101865, cores: 1) Nov 19 19:17:19.281524 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 19:17:20.860932 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:17:20.860932 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: from cryptography.utils import int_from_bytes Nov 19 19:17:20.861663 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:17:20.861663 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: from cryptography.utils import int_from_bytes Nov 19 19:17:20.864703 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:17:20.864703 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: from cryptography.utils import int_from_bytes Nov 19 19:17:20.865231 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:17:20.865231 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: from cryptography.utils import int_from_bytes Nov 19 19:17:23.396713 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 19:17:23.397495 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 19:17:23.397495 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 19:17:23.397834 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 19:17:23.398111 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 19:17:23.398484 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.398817 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.399138 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.399443 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.399780 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.400090 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.400407 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.400716 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.401032 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.401288 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.401601 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.401921 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-13-iscsi {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.402263 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.402570 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.402695 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 19:17:23.403106 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.403196 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 19:17:23.403287 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.403465 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.403781 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.403944 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 19:17:23.404071 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.404255 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 19:17:23.404509 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 19:17:23.404632 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.405760 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406005 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406170 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406356 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406558 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406748 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406946 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.406946 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.407269 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.407354 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.407354 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.407561 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.407657 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.407880 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.408034 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.408189 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.408308 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.408611 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-13-iscsi {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.408758 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.408931 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.409066 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.409242 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.409405 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.409560 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.409777 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.409990 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.410139 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-13-iscsi {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.410334 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.410518 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.410699 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.410902 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.411033 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.411220 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.411351 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.411555 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.411715 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.411879 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.412010 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.412193 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.412323 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.412508 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.412685 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.412841 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.413107 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.413229 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.413413 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.413547 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.413717 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.413920 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.414090 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.414345 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.414517 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.414798 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.414922 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.415190 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.415313 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.415502 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.415627 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.415823 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.415953 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.416140 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.416265 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.416605 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.416756 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.416886 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.417008 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.417134 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.417451 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-13-iscsi {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.417576 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.417774 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.417920 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.418325 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.418453 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.418637 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.418761 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.418945 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.419068 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.419251 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.419376 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.419651 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.419840 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.420122 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.420255 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.420437 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.420565 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.420742 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.420864 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.421118 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.421249 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.421529 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.421673 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.421851 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.422077 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.422270 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.422489 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.422739 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.422867 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.422988 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.423108 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.423243 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.423373 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.423526 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.423719 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.423899 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.424067 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.424208 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.424386 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.424510 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.424696 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.424820 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.425165 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.425355 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.425533 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.425671 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.425920 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.426036 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.426247 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.426467 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.426581 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.426789 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.426924 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.427123 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.427343 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.427476 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.427731 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.427841 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.428039 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.428304 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.428438 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.428545 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.428720 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.428831 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.429055 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.429252 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.429388 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.429682 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.429815 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.430139 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.430269 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.430525 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.430650 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.430855 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.430973 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.431194 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.431371 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.431583 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.431705 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.432011 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.432131 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.432298 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.432418 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.432607 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.432766 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.433024 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.433147 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.433349 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.433473 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.433751 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.433876 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.434100 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.434227 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.434426 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.434568 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.434734 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.435041 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.435161 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.435349 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.435704 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.435840 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436060 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436212 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436362 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436493 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436614 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436742 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.436900 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.437023 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.437335 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.437567 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.437838 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.438128 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.438373 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.438671 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.438806 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.438966 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.439236 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.439454 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.439578 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.439771 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.439927 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.440237 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.440367 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.440544 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.440870 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.441011 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.441268 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.441438 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.441569 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.442011 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.442192 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.442366 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.442613 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.442737 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.442998 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.443649 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.443796 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.443796 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444010 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444111 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444294 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444415 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444613 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444744 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.444919 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445037 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445222 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445343 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445547 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445658 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445852 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.445994 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.446182 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.446446 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.446569 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.446790 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.446911 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.447094 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.447264 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.447420 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.447674 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.447804 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.447992 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.448114 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.448306 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.448520 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.448781 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.448904 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.449086 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.449227 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.449621 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.449745 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.449947 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.450203 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.450405 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.450631 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.450831 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.451040 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.451239 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.451431 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.451431 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.451830 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.452034 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.452034 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.452408 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.452617 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.452820 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.453040 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.453040 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:17:23.453400 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.453538 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.453701 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.453942 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454095 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454219 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454340 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454460 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454578 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454819 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.454974 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.455154 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.455284 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.455461 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.455590 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.455775 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.455898 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.456097 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.456227 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.456614 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.456764 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.456911 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.457218 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.457348 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.457533 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.457662 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.457849 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.458240 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.458444 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.458625 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.458779 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.459006 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.459344 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.459480 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.459632 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.459760 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.459952 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.460201 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.460334 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.460539 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.460664 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.460870 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.460994 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.461188 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.461326 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.461534 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.461656 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.461852 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.461970 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.462207 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.462350 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.462520 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.462642 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.462839 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.463103 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.463249 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.463428 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.463553 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.463807 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.463972 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.464191 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.464332 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.464506 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.464634 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.464823 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.464948 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.465234 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.465444 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.465569 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.465696 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.465859 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.465982 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.466302 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.466480 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.466631 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.466795 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.466953 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.467124 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.467330 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.467517 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.467715 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.467874 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.468001 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.468121 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.468294 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.468449 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.468717 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.468898 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.469276 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.469475 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.469686 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.469822 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.469944 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470099 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470235 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470356 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470487 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470609 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470759 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470893 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.470997 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.471213 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.471467 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.471631 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.471938 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.472061 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.472261 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.472391 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.472649 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.472774 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.472961 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.473084 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.473266 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.473399 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.473640 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.473775 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.473971 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.474224 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.474780 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.474964 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.475282 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.475400 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.475594 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.475716 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.475905 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.476034 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.476382 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.476556 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.476727 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.476869 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.477120 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.477268 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.477405 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.477538 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.477708 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.477860 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.478017 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.478143 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.478457 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.478640 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.478786 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.478926 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.479077 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.479211 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.479344 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.479539 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.479761 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.479943 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.480082 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.480315 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.480488 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.480631 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.480762 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.480957 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.481096 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.481262 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.481392 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.481649 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.481778 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.481951 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.482131 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.482337 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.482592 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.482761 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.482964 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.483103 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.483227 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.483407 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.483543 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.483729 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.483929 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.484135 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.484320 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.484506 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.484697 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.484892 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.485109 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.485306 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.485508 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.485688 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.485827 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.486009 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.486248 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.486486 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.486612 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.486813 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.487158 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.487339 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.487755 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.488084 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.488272 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.488540 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.488755 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.489031 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.489172 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.489495 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.489637 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.489758 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.489878 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.490292 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.490429 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.490583 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.490833 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.491031 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.491157 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.491488 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.491660 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.491806 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.492021 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.492280 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.492403 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.492654 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.492851 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.493038 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.493208 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.493466 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.493678 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.493816 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.494057 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.494179 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.494480 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.494602 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.494808 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.494929 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.495124 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.495277 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.495434 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.495557 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.495745 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.495870 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496054 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496178 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496364 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496495 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496672 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496794 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.496983 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.497091 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.497300 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.497473 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.497607 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.497915 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498083 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498247 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498381 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498565 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498699 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498867 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.498991 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.499177 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.499308 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.499574 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.499829 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.499980 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.500186 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.500385 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.500594 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.500801 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.500968 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.501075 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.501294 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.501629 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.501894 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.502032 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.502279 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.502401 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.502639 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.502774 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.502894 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503021 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503204 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503328 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503511 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503642 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503822 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.503948 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.504126 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.504278 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.504433 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.504555 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.504735 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.504867 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505049 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505173 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505355 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505470 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505657 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505787 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.505956 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.506123 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.506287 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.506409 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.506593 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.506709 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.506895 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507006 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507194 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507317 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507505 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507616 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507805 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.507914 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.508105 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.508240 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.508423 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.508539 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.508731 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.508854 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509030 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509148 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509328 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509443 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509632 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509742 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.509947 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510102 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510250 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510361 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510557 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510674 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510867 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.510980 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.511193 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.511308 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.511498 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.511607 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.511807 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.511923 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.512110 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.512225 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.512417 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.512527 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.512720 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.512831 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513035 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513158 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513340 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513455 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513646 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513770 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.513955 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.514141 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.514289 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.514426 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.514597 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.514720 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.514908 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.515032 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.515300 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.515543 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.515746 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.515947 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516093 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516209 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516338 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516473 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516595 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516789 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.516913 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.517106 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.517372 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.517510 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.517706 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.517830 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.518014 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.518158 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.518348 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.518482 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.518685 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.518923 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.519047 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.519264 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.519398 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.519580 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.519711 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.519898 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520110 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520235 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520363 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520486 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520605 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520790 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.520913 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.521091 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.521224 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.521398 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.521522 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.521700 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.521823 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522003 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522178 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522328 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522464 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522627 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522750 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.522923 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523046 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523221 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523351 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523522 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523648 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523821 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.523946 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.524133 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.524266 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.524432 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.524557 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.524730 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.524863 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525031 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525153 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525348 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525562 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525689 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525808 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.525936 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526081 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526246 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526369 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526545 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526670 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526858 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.526982 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.527171 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.527306 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.527478 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.527602 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.527777 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.527902 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.528083 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.528207 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.528418 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.528555 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.528717 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.528841 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529043 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529166 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529334 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529467 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529635 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529758 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.529932 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.530100 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.530290 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.530418 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.530564 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.530689 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.530910 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.531117 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.531326 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.531539 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.531702 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.531833 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.531956 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532076 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532205 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532327 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532447 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532566 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532686 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532806 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.532977 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.533111 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.533285 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.533410 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.533590 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.533723 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.533887 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534016 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534210 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534344 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534518 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534641 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534822 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.534945 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.535121 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.535243 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.535418 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.535558 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.535713 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.535829 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536014 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536145 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536313 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536443 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536606 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536729 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.536901 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537024 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537195 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537326 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537495 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537616 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537791 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.537912 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.538112 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.538254 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.538412 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.538543 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.538716 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.538837 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539015 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539139 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539315 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539446 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539611 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539732 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.539908 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540032 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540211 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540417 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540541 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540661 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540791 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.540912 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541097 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541222 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541396 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541527 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541695 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541820 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.541993 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.542162 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.542321 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.542456 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.542617 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.542746 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.542910 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543041 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543209 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543344 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543503 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543633 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543798 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.543921 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544092 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544224 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544396 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544518 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544698 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544822 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.544995 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.545132 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.545290 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.545412 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.545585 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.545715 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.545901 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.546026 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.546227 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.546362 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.546553 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.546712 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.546919 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547121 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547287 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547411 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547530 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547651 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547780 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.547903 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.548086 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.548209 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.548386 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.548510 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.548696 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.548828 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549021 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549145 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549329 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549460 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549647 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549774 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.549954 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550146 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550271 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550414 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550607 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550734 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550864 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.550986 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.551167 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.551300 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.551468 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.551593 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.551769 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.551894 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552085 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552282 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552406 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552524 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552678 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552803 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.552987 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.553123 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.553290 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.553415 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.553597 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.553721 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.553901 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554019 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554232 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554360 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554540 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554669 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554846 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.554968 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.555149 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.555272 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.555451 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.555572 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.555749 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.555872 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556055 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556188 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556358 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556481 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556657 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556780 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.556960 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557089 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557265 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557396 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557563 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557689 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557865 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.557987 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.558195 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.558331 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.558479 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.558608 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.558780 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.558916 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559076 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559212 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559383 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559507 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559686 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559810 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.559996 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.560150 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.560299 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.560422 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.560676 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.560807 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.560985 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.561109 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.561297 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.561422 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.561597 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.561720 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.561903 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.562025 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.562286 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.562444 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.562638 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.562838 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563038 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563184 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563304 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563425 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563566 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563705 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.563887 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564011 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564197 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564319 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564506 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564642 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564814 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.564939 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.565115 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.565253 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.565422 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.565559 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.565743 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.565866 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566090 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566218 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566377 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566514 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566678 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566801 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.566998 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.567132 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.567306 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.567461 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.567622 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.567769 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568035 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568159 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568349 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568474 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568651 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568776 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.568986 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.569108 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.569289 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.569413 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.569600 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.569725 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.569907 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.570031 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.570252 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.570377 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.570569 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.570708 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.570899 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571024 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571165 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571296 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571458 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571593 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571772 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.571903 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.572090 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.572220 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.572396 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.572518 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.572702 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.572928 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.573059 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.573306 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.573432 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.573624 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.573755 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.573932 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.574105 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.574276 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.574430 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.574595 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.574727 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.574897 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.575021 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.575195 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.575320 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.575502 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.575635 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.575878 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576003 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576187 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576335 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576497 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576626 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576783 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.576916 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.577083 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.577207 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.577387 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.577511 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.577721 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.577874 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.578097 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.578307 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.578523 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.578654 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.578783 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.578914 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579088 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579210 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579330 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579449 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579575 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579710 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579832 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.579952 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.580112 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.580246 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.580414 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.580540 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.580731 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.580856 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581063 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581197 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581328 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581450 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581614 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581740 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.581913 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.582037 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.582275 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.582403 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.582576 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.582708 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.582885 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583008 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583183 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583309 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583517 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583649 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583821 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.583955 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.584139 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.584263 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.584459 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.584581 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.584771 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.584908 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585073 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585196 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585390 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585513 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585689 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585823 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.585988 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.586132 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.586327 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.586452 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.586627 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.586762 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.586928 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587051 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587225 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587347 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587528 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587661 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587826 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.587949 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.588121 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.588251 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.588416 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.588541 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.588717 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.588840 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589013 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589137 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589312 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589440 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589607 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589731 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.589903 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.590026 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.590428 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.590557 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.590557 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.590802 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.590802 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591055 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591254 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591380 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591501 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591631 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591805 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.591936 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592065 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592197 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592327 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592449 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592608 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592746 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.592929 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.593056 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.593239 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.593417 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.593599 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.593829 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594034 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594236 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594361 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594480 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594610 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594732 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.594882 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595015 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595196 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595328 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595519 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595645 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595843 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.595969 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.596164 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.596290 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.596474 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.596604 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.596786 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597029 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597155 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597360 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597560 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597684 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597805 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.597975 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.598260 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.598405 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.598595 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.598720 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.598909 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.599035 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.599217 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.599705 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.599883 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600006 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600193 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600321 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600510 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600647 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600817 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.600950 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.601129 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.601269 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.601471 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.601598 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.601719 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.601840 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.602062 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.602203 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.602380 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.602507 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.602694 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.602818 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603003 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603141 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603322 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603459 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603631 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603757 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.603939 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.604073 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.604247 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.604371 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.604560 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.604685 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.604886 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605010 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605169 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605300 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605478 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605603 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605786 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.605910 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.606113 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.606252 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.606423 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.606542 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.606727 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.606852 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607033 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607150 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607337 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607461 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607642 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607766 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.607946 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.608071 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.608253 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.608387 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.608560 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.608685 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.608872 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.609016 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.609237 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.609460 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.609643 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.609844 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.609970 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.610175 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.610314 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.610486 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.610614 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.610869 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611001 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611189 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611333 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611556 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611692 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611814 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.611935 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.612116 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.612250 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.612417 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.612541 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.612718 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.612850 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613023 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613156 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613327 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613453 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613626 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613752 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.613940 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.614106 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.614269 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.614394 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.614570 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.614696 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.614885 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.615018 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.615189 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.615313 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.615489 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.615707 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.615842 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.616051 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.616177 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.616363 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.616599 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.616731 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.616941 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.617073 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.617256 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.617380 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.617582 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.617714 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.617901 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618027 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618228 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618352 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618527 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618664 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618838 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.618964 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.619136 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.619272 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.619434 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.619565 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.619739 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.619863 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620041 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620164 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620342 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620480 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620637 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620759 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.620941 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621065 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621236 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621359 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621531 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621736 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621863 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.621984 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.622176 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.622301 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.622424 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.622542 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.622733 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.622865 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623032 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623157 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623328 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623457 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623627 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623752 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.623924 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.624047 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.624224 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.624350 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.624518 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.624711 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.624917 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625121 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625325 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625465 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625595 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625731 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625854 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.625978 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626117 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626240 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626363 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626502 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626648 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626767 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.626946 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627071 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627245 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627376 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627552 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627675 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627850 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.627972 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.628150 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.628284 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.628457 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.628580 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.628758 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.628881 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.629075 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.629201 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.629384 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.629508 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.629691 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.629902 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.630082 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.630300 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.630436 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.630618 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.630864 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.630989 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.631243 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.631369 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.631558 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.631682 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.631901 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632028 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632159 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632280 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632450 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632577 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632757 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.632890 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.633067 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.633192 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.633371 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.633496 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.633676 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.633878 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634003 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634154 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634297 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634432 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634602 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634739 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.634908 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635030 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635212 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635334 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635515 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635639 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635817 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.635942 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.636123 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.636254 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.636436 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.636561 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.636758 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.636874 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637072 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637202 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637376 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637498 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637682 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637806 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.637989 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.638156 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.638317 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.638441 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.638624 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.638749 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.638928 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639067 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639233 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639358 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639532 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639665 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639853 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.639989 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.640193 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.640329 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.640534 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.640737 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.640923 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.641190 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.641317 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.641500 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.641624 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.641817 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642032 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642189 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642310 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642432 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642552 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642756 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.642895 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.643061 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.643193 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.643375 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.643498 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.643684 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.643810 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644007 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644133 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644323 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644463 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644627 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644760 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.644940 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645065 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645244 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645382 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645542 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645666 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645843 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.645969 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.646171 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.646299 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.646495 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.646621 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.646811 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.646935 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.647118 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.647250 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.647433 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.647557 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.647736 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.647859 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648049 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648180 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648350 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648474 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648663 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648785 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.648970 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.649107 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.649285 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.649410 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.649589 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.649720 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.649896 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650028 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650229 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650354 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650536 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650660 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650841 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.650967 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.651145 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.651268 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.651448 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.651574 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.651753 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.651879 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652083 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652216 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652375 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652503 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652675 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652799 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.652990 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.653114 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.653300 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.653434 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.653608 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.653733 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.653918 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.654069 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.654265 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.654402 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.654566 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.654700 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.654874 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.655000 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.655181 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.655314 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.655488 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.655613 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.655815 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.656118 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.656329 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.656543 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.656751 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.656928 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.657063 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.657169 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.657284 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.657440 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.657675 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.657802 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.658112 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.658243 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.658426 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.658559 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.658769 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.658903 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.659095 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.659229 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.659406 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.659543 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.659713 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.659839 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.660014 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.660148 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:17:23.660271 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101865) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 19:17:23.660392 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=101864) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 19:17:23.683011 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:23.684372 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:23.751850 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.context [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12fc2f6-cd8d-4c14-9fdc-caa783139795(cell1) {{(pid=101864) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 19:17:23.752115 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.context [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12fc2f6-cd8d-4c14-9fdc-caa783139795(cell1) {{(pid=101865) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 19:17:23.756168 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:17:23.756406 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:17:23.757672 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:17:23.757992 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:17:23.758510 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:17:23.758833 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:17:23.760425 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:17:23.760793 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_concurrency.lockutils [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=101865) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:17:23.771597 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:23.774806 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:23.778589 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:23.784163 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:24.046073 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_db.sqlalchemy.engines [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101864) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:24.049019 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG oslo_db.sqlalchemy.engines [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=101865) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:17:24.383152 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:17:24.388490 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:17:24.389540 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:17:24.395029 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:17:24.606431 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:17:24.611764 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: WARNING keystonemiddleware.auth_token [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:17:24.615625 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:17:24.617073 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d68a1e9c0 pid: 101865 (default app) Nov 19 19:17:24.619138 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:17:24.620300 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001701 Nov 19 19:17:24.620705 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Fri Nov 19 19:17:24 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:17:24.620840 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: WARNING keystonemiddleware.auth_token [None req-0bcce605-0bde-4f21-83c2-e2fba2878cd8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:17:24.626184 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556d68a1e9c0 pid: 101864 (default app) Nov 19 19:18:47.189408 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:18:47.191073 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Nov 19 19:18:47.191470 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:18:47 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:18:47.809161 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-f9df043f-65c3-463d-af62-c01ad66e82cb admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:18:47.840962 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-f9df043f-65c3-463d-af62-c01ad66e82cb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.642012 Nov 19 19:18:47.842102 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Nov 19 19:18:47 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:18:50.312967 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:18:50.314128 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-41a85d7c-63f8-4620-9abb-598e654fa8c1 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Nov 19 19:18:50.318546 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:18:50 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:18:50.382556 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-a810d8e0-a3a3-4db0-9363-3a46807dfe93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "id": "c1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:50.402074 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:18:50.402074 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Nov 19 19:18:50.444368 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-a810d8e0-a3a3-4db0-9363-3a46807dfe93 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.122676 Nov 19 19:18:50.445327 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:18:50 2021] POST /compute/v2.1/flavors => generated 407 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:18:50.793226 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-396b78f5-6ee3-4289-92a9-51f923320b4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:50.795720 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:18:50.795720 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: warnings.warn(msg) Nov 19 19:18:50.848058 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-396b78f5-6ee3-4289-92a9-51f923320b4c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.394589 Nov 19 19:18:50.849208 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Nov 19 19:18:50 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:18:53.190956 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-a810d8e0-a3a3-4db0-9363-3a46807dfe93 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:18:53.192121 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-a810d8e0-a3a3-4db0-9363-3a46807dfe93 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001869 Nov 19 19:18:53.192808 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:18:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:18:53.323493 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-67cee207-c6c0-423c-b2a6-bf49a5045dc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:53.341173 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:18:53.341173 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: warnings.warn(msg) Nov 19 19:18:53.365788 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-67cee207-c6c0-423c-b2a6-bf49a5045dc1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.164978 Nov 19 19:18:53.366528 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:18:53 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:18:53.379163 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-981d8ad9-8916-4316-9acc-86e0607ceead admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:53.380723 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:18:53.380723 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Nov 19 19:18:53.420883 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-981d8ad9-8916-4316-9acc-86e0607ceead admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045731 Nov 19 19:18:53.421501 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Nov 19 19:18:53 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:18:55.736044 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-67cee207-c6c0-423c-b2a6-bf49a5045dc1 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:18:55.737130 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-67cee207-c6c0-423c-b2a6-bf49a5045dc1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Nov 19 19:18:55.737500 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:18:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:18:55.799090 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-f7da4d37-40ea-4118-96fd-7af47d2f2b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:55.821111 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-f7da4d37-40ea-4118-96fd-7af47d2f2b10 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076992 Nov 19 19:18:55.826451 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:18:55 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:18:55.834941 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-4b7d9847-f236-4738-9896-5f413f9b9ba1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:55.861265 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-4b7d9847-f236-4738-9896-5f413f9b9ba1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030505 Nov 19 19:18:55.861925 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Nov 19 19:18:55 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:18:58.219474 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-f7da4d37-40ea-4118-96fd-7af47d2f2b10 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:18:58.220516 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-f7da4d37-40ea-4118-96fd-7af47d2f2b10 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Nov 19 19:18:58.220944 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:18:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:18:58.280355 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-33c21025-2c51-496b-bf99-c6f2a6002a8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "disk": 10}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:58.299826 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-33c21025-2c51-496b-bf99-c6f2a6002a8a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071835 Nov 19 19:18:58.300390 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:18:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:18:58.312474 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-01308f8d-6cfd-42c7-8337-2246f1822102 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:18:58.336139 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-01308f8d-6cfd-42c7-8337-2246f1822102 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027291 Nov 19 19:18:58.336718 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Nov 19 19:18:58 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:19:00.776550 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-33c21025-2c51-496b-bf99-c6f2a6002a8a admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:00.777562 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-33c21025-2c51-496b-bf99-c6f2a6002a8a admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Nov 19 19:19:00.777994 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:00 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:00.842088 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-1a553e01-ba98-4e08-b672-34cf026a1069 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "swap": 0, "vcpus": 4, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:00.865841 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-1a553e01-ba98-4e08-b672-34cf026a1069 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080711 Nov 19 19:19:00.867190 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:19:00 2021] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:00.880142 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-83a8b660-eb75-4e9d-91b3-036c7d6f2b9f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:00.905686 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-83a8b660-eb75-4e9d-91b3-036c7d6f2b9f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030013 Nov 19 19:19:00.918080 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Nov 19 19:19:00 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:19:03.279486 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-1a553e01-ba98-4e08-b672-34cf026a1069 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:03.280587 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-1a553e01-ba98-4e08-b672-34cf026a1069 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Nov 19 19:19:03.281003 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:03.363270 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-53cbd435-57a9-41cf-bd81-61dab1de6113 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:03.389076 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-53cbd435-57a9-41cf-bd81-61dab1de6113 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.099935 Nov 19 19:19:03.389634 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Nov 19 19:19:03 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:05.769582 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-1a553e01-ba98-4e08-b672-34cf026a1069 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:05.770665 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-1a553e01-ba98-4e08-b672-34cf026a1069 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Nov 19 19:19:05.771086 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:05.867063 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c403a706-1a5f-44ca-ba1b-e03dce0b286e admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:05.892276 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-c403a706-1a5f-44ca-ba1b-e03dce0b286e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.109434 Nov 19 19:19:05.892860 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:19:05 2021] POST /compute/v2.1/flavors => generated 402 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:05.905590 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-15433bc8-0738-4027-a59b-45e6ed2d0ae9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:05.932699 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-15433bc8-0738-4027-a59b-45e6ed2d0ae9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030726 Nov 19 19:19:05.933583 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Nov 19 19:19:05 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:19:08.481955 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c403a706-1a5f-44ca-ba1b-e03dce0b286e admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:08.483096 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-c403a706-1a5f-44ca-ba1b-e03dce0b286e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Nov 19 19:19:08.483508 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:08.542856 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-1cc93ae0-7ba0-433f-add1-bb8ebe16423c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:08.561630 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-1cc93ae0-7ba0-433f-add1-bb8ebe16423c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.071657 Nov 19 19:19:08.562226 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:19:08 2021] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:08.575701 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-0d0dbeb8-f56b-4a0e-a477-d333d2d8229f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:08.601674 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-0d0dbeb8-f56b-4a0e-a477-d333d2d8229f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030570 Nov 19 19:19:08.602438 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Nov 19 19:19:08 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:19:10.897496 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-1cc93ae0-7ba0-433f-add1-bb8ebe16423c admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:10.898591 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-1cc93ae0-7ba0-433f-add1-bb8ebe16423c admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001721 Nov 19 19:19:10.899049 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:10.965707 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-b1e7356c-14dd-4bc8-b0cf-02b090a37e18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "name": "m1.medium"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:10.987083 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-b1e7356c-14dd-4bc8-b0cf-02b090a37e18 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079555 Nov 19 19:19:10.987647 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:19:10 2021] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:11.000105 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-240719ec-3f4c-4f8f-8649-ec0292f129cd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:11.027419 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-240719ec-3f4c-4f8f-8649-ec0292f129cd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030984 Nov 19 19:19:11.028044 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Nov 19 19:19:10 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:19:13.422433 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-b1e7356c-14dd-4bc8-b0cf-02b090a37e18 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:13.424968 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-b1e7356c-14dd-4bc8-b0cf-02b090a37e18 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002997 Nov 19 19:19:13.425621 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:13 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:13.518937 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-db84a951-74b7-4597-a098-b9a0d199d413 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:13.557487 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-db84a951-74b7-4597-a098-b9a0d199d413 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.124935 Nov 19 19:19:13.558076 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:19:13 2021] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:13.574075 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-2764207e-927b-4ceb-96cb-e30759276cda admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:13.599276 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-2764207e-927b-4ceb-96cb-e30759276cda admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032410 Nov 19 19:19:13.600449 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Nov 19 19:19:13 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:19:15.987718 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-db84a951-74b7-4597-a098-b9a0d199d413 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:15.988743 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-db84a951-74b7-4597-a098-b9a0d199d413 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Nov 19 19:19:15.989348 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:15 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:16.057484 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-622dc211-d3b5-4f44-a24b-640bfe83caa7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "name": "m1.xlarge", "disk": 160, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:16.086029 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-622dc211-d3b5-4f44-a24b-640bfe83caa7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089781 Nov 19 19:19:16.090450 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Nov 19 19:19:15 2021] POST /compute/v2.1/flavors => generated 408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:19:16.099871 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-4a01d09c-857c-427e-a881-632c9151ebce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:16.127318 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-4a01d09c-857c-427e-a881-632c9151ebce admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031465 Nov 19 19:19:16.128032 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Nov 19 19:19:16 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:19:37.889348 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-622dc211-d3b5-4f44-a24b-640bfe83caa7 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:37.890454 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-622dc211-d3b5-4f44-a24b-640bfe83caa7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Nov 19 19:19:37.890857 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:19:37 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:37.954170 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-e74635d2-9eeb-42e5-bfc2-d3b7d1c6f174 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:37.971220 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-e74635d2-9eeb-42e5-bfc2-d3b7d1c6f174 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073609 Nov 19 19:19:37.971767 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Nov 19 19:19:37 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:39.468025 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-622dc211-d3b5-4f44-a24b-640bfe83caa7 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:39.469038 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-622dc211-d3b5-4f44-a24b-640bfe83caa7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 19 19:19:39.469446 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:39 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:39.665394 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-03098813-be22-418c-b2c4-542abf915120 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:39.671291 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.wsgi [None req-03098813-be22-418c-b2c4-542abf915120 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 19:19:39.671851 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-03098813-be22-418c-b2c4-542abf915120 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:19:39.672640 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-03098813-be22-418c-b2c4-542abf915120 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062491 Nov 19 19:19:39.673150 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Nov 19 19:19:39 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:19:39.683609 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-17a9855b-98ca-4610-b366-4ce389ad7893 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:39.704443 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-17a9855b-98ca-4610-b366-4ce389ad7893 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024438 Nov 19 19:19:39.705102 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Nov 19 19:19:39 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:39.715615 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-241b80dd-f31b-4b9e-8c6c-9a88824aa93b admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:39.737251 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-241b80dd-f31b-4b9e-8c6c-9a88824aa93b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025127 Nov 19 19:19:39.737804 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Nov 19 19:19:39 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:39.748010 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c731974a-c9b4-446b-8079-d68408ab19b3 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:39.753986 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-c731974a-c9b4-446b-8079-d68408ab19b3 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 19 19:19:39.754595 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-c731974a-c9b4-446b-8079-d68408ab19b3 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:19:39.755395 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-c731974a-c9b4-446b-8079-d68408ab19b3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011038 Nov 19 19:19:39.755899 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Nov 19 19:19:39 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:19:41.137590 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-241b80dd-f31b-4b9e-8c6c-9a88824aa93b admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:41.138636 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-241b80dd-f31b-4b9e-8c6c-9a88824aa93b admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Nov 19 19:19:41.139076 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:41 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:41.338012 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-4c2abbf9-1841-4d98-b0af-22d0f94d9ee8 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:41.344185 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-4c2abbf9-1841-4d98-b0af-22d0f94d9ee8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 19:19:41.344750 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-4c2abbf9-1841-4d98-b0af-22d0f94d9ee8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:19:41.345606 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-4c2abbf9-1841-4d98-b0af-22d0f94d9ee8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062568 Nov 19 19:19:41.346417 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Nov 19 19:19:41 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:19:41.356878 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-f8aea1cb-3ae2-4871-b0cf-36048583c143 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:41.371144 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-f8aea1cb-3ae2-4871-b0cf-36048583c143 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017877 Nov 19 19:19:41.371670 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Nov 19 19:19:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:41.381845 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-20a6fc57-2bb3-4753-846d-608fad73dbe6 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:41.395555 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-20a6fc57-2bb3-4753-846d-608fad73dbe6 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017198 Nov 19 19:19:41.396080 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Nov 19 19:19:41 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:41.405779 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-6bbae4ab-6b4f-438e-9d6e-cd4d80b5260c admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:41.411795 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.wsgi [None req-6bbae4ab-6b4f-438e-9d6e-cd4d80b5260c admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 19 19:19:41.412347 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-6bbae4ab-6b4f-438e-9d6e-cd4d80b5260c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=101864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:19:41.413134 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-6bbae4ab-6b4f-438e-9d6e-cd4d80b5260c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010835 Nov 19 19:19:41.413624 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Nov 19 19:19:41 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:19:42.787771 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-20a6fc57-2bb3-4753-846d-608fad73dbe6 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:42.788776 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-20a6fc57-2bb3-4753-846d-608fad73dbe6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Nov 19 19:19:42.789185 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:42.990172 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-2498bec9-ac78-49a2-b9b9-1933d0dd5467 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:42.995914 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.wsgi [None req-2498bec9-ac78-49a2-b9b9-1933d0dd5467 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 19:19:42.996384 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-2498bec9-ac78-49a2-b9b9-1933d0dd5467 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101864) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:19:42.997195 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-2498bec9-ac78-49a2-b9b9-1933d0dd5467 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061526 Nov 19 19:19:42.997740 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Nov 19 19:19:42 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:19:43.009235 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-91aa67d0-004d-4f7e-9f02-1b5775de5f00 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:43.023267 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-91aa67d0-004d-4f7e-9f02-1b5775de5f00 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017637 Nov 19 19:19:43.023837 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Nov 19 19:19:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:19:43.035905 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:43.050371 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019109 Nov 19 19:19:43.050954 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Nov 19 19:19:43 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:19:43.065059 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ef83390a-5230-4bd4-b13c-ce51f8d26725 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:43.070822 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.wsgi [None req-ef83390a-5230-4bd4-b13c-ce51f8d26725 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 19 19:19:43.071395 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ef83390a-5230-4bd4-b13c-ce51f8d26725 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=101865) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:19:43.072190 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ef83390a-5230-4bd4-b13c-ce51f8d26725 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011108 Nov 19 19:19:43.072708 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Nov 19 19:19:43 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:19:44.473555 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:44.474595 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Nov 19 19:19:44.474993 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:44 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:44.681612 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-a7f33342-0c90-4987-b43d-5c77da7b11d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:44.701955 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-a7f33342-0c90-4987-b43d-5c77da7b11d8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083336 Nov 19 19:19:44.702543 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Nov 19 19:19:44 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:19:46.119017 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:46.120026 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Nov 19 19:19:46.120436 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:46.321801 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-88e1c9eb-fa47-4dd4-9074-465246539d7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:46.348940 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-88e1c9eb-fa47-4dd4-9074-465246539d7e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.091437 Nov 19 19:19:46.349503 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Nov 19 19:19:46 2021] POST /compute/v2.1/flavors => generated 405 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:47.759181 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:47.760212 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Nov 19 19:19:47.760621 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:47 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:47.971107 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-d0ea5b03-6a4d-4211-b516-4d806b627460 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:47.993573 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-d0ea5b03-6a4d-4211-b516-4d806b627460 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082210 Nov 19 19:19:47.994145 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Nov 19 19:19:47 2021] POST /compute/v2.1/flavors => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:49.466705 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:49.467974 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001905 Nov 19 19:19:49.468470 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:49 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:49.673936 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-44c9c5af-a191-4fe6-8d1f-615c4cfe1373 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:19:49.692951 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-44c9c5af-a191-4fe6-8d1f-615c4cfe1373 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082817 Nov 19 19:19:49.693508 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Nov 19 19:19:49 2021] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:19:51.085626 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:51.086709 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Nov 19 19:19:51.087115 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:19:51 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:19:51.292810 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-46001185-11b1-4638-ae73-7644db6b995d admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:19:51.312633 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-46001185-11b1-4638-ae73-7644db6b995d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.083058 Nov 19 19:19:51.313178 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Fri Nov 19 19:19:51 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:20:38.465257 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:20:38.466322 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0b2e1ecc-9a95-4320-b89b-42626c64d8d8 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Nov 19 19:20:38.466726 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Fri Nov 19 19:20:38 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:20:38.530332 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-9080614c-916e-4ac2-94f4-2ea19c1e10ca admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:20:38.550074 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-9080614c-916e-4ac2-94f4-2ea19c1e10ca admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075691 Nov 19 19:20:38.550646 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Nov 19 19:20:38 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:20:38.574288 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-36348b72-4c09-4802-aca7-6e228462816e admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:20:38.582214 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-36348b72-4c09-4802-aca7-6e228462816e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011557 Nov 19 19:20:38.582747 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Fri Nov 19 19:20:38 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:20:38.594901 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-33174acb-4375-4819-9dd1-c4248c9e9b3b admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:20:38.603157 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-33174acb-4375-4819-9dd1-c4248c9e9b3b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011919 Nov 19 19:20:38.603692 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Fri Nov 19 19:20:38 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:20:38.615651 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-ab73ecbd-b034-426f-8c18-ad70344db4c5 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:20:38.623491 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-ab73ecbd-b034-426f-8c18-ad70344db4c5 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011461 Nov 19 19:20:38.624016 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Fri Nov 19 19:20:38 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:20:38.636060 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:20:38.644040 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011555 Nov 19 19:20:38.644568 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Fri Nov 19 19:20:38 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:22:01.589194 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-63eee49c-14bb-460e-b5d8-b477e2b0c123 tempest-verify_tempest_config-614130115 tempest-verify_tempest_config-614130115-project] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:22:01.591234 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-63eee49c-14bb-460e-b5d8-b477e2b0c123 tempest-verify_tempest_config-614130115 tempest-verify_tempest_config-614130115-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.110934 Nov 19 19:22:01.591771 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 34/69] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Nov 19 19:22:01 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:23:33.005821 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:33.006872 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Nov 19 19:23:33.007239 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 36/70] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:23:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:23:33.265233 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-78da7dbc-398e-4409-9fa4-f680871bb8e8 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:33.266419 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:23:33.266419 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Nov 19 19:23:33.267975 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-78da7dbc-398e-4409-9fa4-f680871bb8e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:33.268413 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-78da7dbc-398e-4409-9fa4-f680871bb8e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:33.269187 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-78da7dbc-398e-4409-9fa4-f680871bb8e8 admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:33.269608 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-78da7dbc-398e-4409-9fa4-f680871bb8e8 admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:33.303168 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-78da7dbc-398e-4409-9fa4-f680871bb8e8 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.154340 Nov 19 19:23:33.303748 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 35/71] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Nov 19 19:23:33 2021] GET /compute/v2.1/os-services => generated 794 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:23:34.713623 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:34.714760 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001593 Nov 19 19:23:34.715157 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 37/72] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:23:34 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:23:34.908605 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-6efd8774-6824-441e-b6ca-8c002d536657 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:34.909763 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:23:34.909763 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Nov 19 19:23:34.911342 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-6efd8774-6824-441e-b6ca-8c002d536657 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:34.911782 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-6efd8774-6824-441e-b6ca-8c002d536657 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:34.912566 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-6efd8774-6824-441e-b6ca-8c002d536657 admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:34.912989 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-6efd8774-6824-441e-b6ca-8c002d536657 admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:34.931728 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-6efd8774-6824-441e-b6ca-8c002d536657 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078381 Nov 19 19:23:34.932207 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 36/73] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Nov 19 19:23:34 2021] GET /compute/v2.1/os-services => generated 794 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:23:46.794972 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:46.796005 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Nov 19 19:23:46.796400 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 38/74] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:23:46 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:23:46.993055 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-0c6ecfad-aad1-4869-ac8d-22ee4a7b4297 admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:46.994391 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:23:46.994391 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Nov 19 19:23:46.995906 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0c6ecfad-aad1-4869-ac8d-22ee4a7b4297 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:46.996340 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0c6ecfad-aad1-4869-ac8d-22ee4a7b4297 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:46.997125 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0c6ecfad-aad1-4869-ac8d-22ee4a7b4297 admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:46.997544 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-0c6ecfad-aad1-4869-ac8d-22ee4a7b4297 admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:47.022692 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-0c6ecfad-aad1-4869-ac8d-22ee4a7b4297 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.087577 Nov 19 19:23:47.023209 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 37/75] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Nov 19 19:23:46 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:23:48.444123 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: DEBUG nova.api.openstack.wsgi [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] Calling method '>' {{(pid=101865) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:48.445130 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: INFO nova.api.openstack.requestlog [None req-ae955260-2e05-4107-a763-583b61bb4e87 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 19 19:23:48.445532 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: [pid: 101865|app: 0|req: 39/76] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Nov 19 19:23:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:23:48.641978 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG nova.api.openstack.wsgi [None req-1ec96109-1f42-4891-959b-6d5c39d83dce admin admin] Calling method '>' {{(pid=101864) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:23:48.643082 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:23:48.643082 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: warnings.warn(msg) Nov 19 19:23:48.644617 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-1ec96109-1f42-4891-959b-6d5c39d83dce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:48.645050 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-1ec96109-1f42-4891-959b-6d5c39d83dce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:48.645830 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-1ec96109-1f42-4891-959b-6d5c39d83dce admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:23:48.646276 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: DEBUG oslo_concurrency.lockutils [None req-1ec96109-1f42-4891-959b-6d5c39d83dce admin admin] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=101864) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:23:48.666911 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: INFO nova.api.openstack.requestlog [None req-1ec96109-1f42-4891-959b-6d5c39d83dce admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.081505 Nov 19 19:23:48.667459 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: [pid: 101864|app: 0|req: 38/77] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Nov 19 19:23:48 2021] GET /compute/v2.1/os-services => generated 1038 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:24:45.953875 dv-cinder-777031-13-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 19 19:24:45.954497 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: Fri Nov 19 19:24:45 2021 - graceful shutdown triggered... Nov 19 19:24:45.954921 dv-cinder-777031-13-iscsi devstack@n-api.service[101864]: Gracefully killing worker 1 (pid: 101864)... Nov 19 19:24:45.955274 dv-cinder-777031-13-iscsi devstack@n-api.service[101865]: Gracefully killing worker 2 (pid: 101865)... Nov 19 19:24:46.955672 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: worker 1 buried after 1 seconds Nov 19 19:24:46.955672 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: worker 2 buried after 1 seconds Nov 19 19:24:46.955672 dv-cinder-777031-13-iscsi devstack@n-api.service[101863]: goodbye to uWSGI. Nov 19 19:24:46.957404 dv-cinder-777031-13-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 19 19:24:46.957986 dv-cinder-777031-13-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 19 19:24:46.961142 dv-cinder-777031-13-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 19 19:24:46.970588 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Nov 19 19:24:46 2021] *** Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: nodename: dv-cinder-777031-13-iscsi Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: machine: x86_64 Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: clock source: unix Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: pcre jit disabled Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: detected number of CPU cores: 4 Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: current working directory: / Nov 19 19:24:46.972954 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: detected binary path: /usr/bin/uwsgi-core Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: your processes number limit is 47680 Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: your memory page size is 4096 bytes Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: detected max file descriptor number: 2048 Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: lock engine: pthread robust mutexes Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: thunder lock: enabled Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 19 19:24:46.973748 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 19 19:24:47.017434 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: Python main interpreter initialized at 0x55f9c2a5c9c0 Nov 19 19:24:47.017434 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: python threads support enabled Nov 19 19:24:47.017434 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: your server socket listen backlog is limited to 100 connections Nov 19 19:24:47.017434 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: your mercy for graceful operations on workers is 90 seconds Nov 19 19:24:47.017901 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: mapped 403077 bytes (393 KB) for 2 cores Nov 19 19:24:47.017901 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: *** Operational MODE: preforking *** Nov 19 19:24:47.020928 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: *** uWSGI is running in multiple interpreter mode *** Nov 19 19:24:47.020928 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: spawned uWSGI master process (pid: 116088) Nov 19 19:24:47.020928 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: spawned uWSGI worker 1 (pid: 116110, cores: 1) Nov 19 19:24:47.020928 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: spawned uWSGI worker 2 (pid: 116111, cores: 1) Nov 19 19:24:47.020928 dv-cinder-777031-13-iscsi devstack@n-api.service[116088]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 19 19:24:47.018425 dv-cinder-777031-13-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 19 19:24:48.774605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:24:48.774605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: from cryptography.utils import int_from_bytes Nov 19 19:24:48.775326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:24:48.775326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: from cryptography.utils import int_from_bytes Nov 19 19:24:48.799413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:24:48.799413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: from cryptography.utils import int_from_bytes Nov 19 19:24:48.800125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 19 19:24:48.800125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: from cryptography.utils import int_from_bytes Nov 19 19:24:51.128503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 19:24:51.129127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 19:24:51.129351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 19:24:51.129653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 19:24:51.129926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 19:24:51.130346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.130684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.131037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.131361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.131697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.132013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.132349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.133033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.133464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.133862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.134081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.134412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-13-iscsi {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.134745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.135065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.135369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.135694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.136000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.136315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.136938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.137627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.138997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.138997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.138997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.139385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.139671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.139982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.140313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.140628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.140963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.141284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.141704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-13-iscsi {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.142034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.142390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.142705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.143143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.143453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.143772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.144101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.144455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.144749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.145083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.145412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.145748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.146092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.146406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.146728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.147047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.147373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.147700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.148062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.148324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.148643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.149034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.149295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.149628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.149880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.150160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.150488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.150816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.151132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.151446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.151758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.152069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.152382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.152694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.153006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.153327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.153641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.153961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.154317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.154632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.154956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.155363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.155618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.155930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.156894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.157245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.157569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.157909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.158264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.158593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.158902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.159216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.159545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.159888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.160203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.160463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.160775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.161113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.161429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.161729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.162061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.162378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.162686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.163000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.163304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.163749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.164077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.164376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.164691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.165033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.165315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.165626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.165953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.166309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.166631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.166945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.167260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.167565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.167899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.168204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.168516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.168846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.169156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.169468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.169792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.170145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.170442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.170772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.171072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.171391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.171724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.172023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.172337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.172645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.172956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.173269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.173591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.173892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.174246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.174558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.174883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.175211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.175528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.175841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.176152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.176492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.176833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.177170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.177523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.177847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.178209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.178549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.178940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.179190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.179675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.180015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.180339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.180663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.180987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.181312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.181640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.181977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.182392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.182665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.183417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.183417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.183721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.183975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.184259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.184577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.184735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 19 19:24:51.185243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 19 19:24:51.185396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.185396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.185692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 19 19:24:51.185837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.185990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 19 19:24:51.186177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.186321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 19 19:24:51.186478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.186621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.186772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.186916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.187065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.187217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.187366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.187516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.187681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.187835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.187986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.188145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.188473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.188633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.188787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.188940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.189215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.189376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.189519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.189661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.189812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.189966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.190156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.190977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-777031-13-iscsi {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.191224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.191372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.191372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.191762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.191910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.192196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.192365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.192752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.192921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.193087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.193272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.193416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.193565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.193717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.193717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.194027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.194312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.194476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.194621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.194778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.194981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.195140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.195295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.195447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.195604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.195755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.195905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.196067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.196218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.196369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.196527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.196671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.196826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.196988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.197130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.197130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.197428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.197571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.197720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-777031-13-iscsi {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.197863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.198005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.198278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.198624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.198776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.198925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.199083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.199083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.199520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.199678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.199835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.199989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.200137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.200295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.200446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.200589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.200730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.200880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.201033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.201221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.201465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.201614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.201775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.201775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.202214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.202496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.202772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.203014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.203161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.203302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.203454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.203608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.203757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.203757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.204027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.204027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.204424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.204574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.204709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.204860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.205147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.205376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.205530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.205679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.205853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.205994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.206148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.206245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.206320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.206402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.206475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.206553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.206631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.206712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.206785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.206861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.206938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.207017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.207100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.207172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.207253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.207332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.207410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.207486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.207570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.207648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.207721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.207799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.207877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.208123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.208223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.208434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.209117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.209117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.209570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.209846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.209998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.210198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.210345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.210345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.211270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.211270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.211763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.211763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.212178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.212285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.212373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.212484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.212578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.212578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.212772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.212869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.212965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.213078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.213171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.213269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.213355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.213436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.213519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.213602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.213697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.213788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.213873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.213963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.214186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.214288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.214413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.214501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.214593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.214685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.214777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.214971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.215078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.216061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.216185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.216283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.216369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.216460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.216561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.216648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.216732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.216815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.216908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.216908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.217080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.217171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.217264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.217414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.217507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.217724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.217817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.218036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.218291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.218378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.218470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.218670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.218763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.218990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.219105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.219315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.219424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.219619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.219712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.219931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.220061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.220237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.220361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.220543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.220652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.220862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.220969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.221169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.221274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.221478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.221577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.221795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.221892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.222136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.222609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.222797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.222910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.223121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.223292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.223433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.223568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.223728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.223877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.224030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.224169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.224395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.224532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.224670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.224825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.224971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.225118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.225264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.225403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.225552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.225715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.225855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.226000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.226186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.226357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.226722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.226911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.227119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.227293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.227429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.227634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.227786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.227943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.228091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.228262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.228403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.228581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.228729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.228899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.229046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.229233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.229382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.229530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.229678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.229832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 19 19:24:51.230008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.230196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.230300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.230529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.230635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.230850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.230943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.231175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.231275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.231494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.231592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.231814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.231919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.232141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.232264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.232460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.232557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.232773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.232861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.233093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.233192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.233412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.233521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.233725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.233816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.234037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.234161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.234394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.234493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.234713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.234810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.235973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.236070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.236286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.236376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.236604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.236888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.237000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.237242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.237356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.238919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.239935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.240151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.240240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.240465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.240564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.240772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.240861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.241090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.241170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.241404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.241490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.241717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.241885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.242516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.242693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.242693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.242982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.243136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.243284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.243424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.243674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.243818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.243966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.244913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.245084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.245183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.245398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.245488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.245780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.245905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.246103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.246201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.246420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.246536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.246737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.247030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.247189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.247348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.247633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.247790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.247944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.248096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.248448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.248693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.248851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.248996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.249148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.249304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.249456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.249609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.250035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.250408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.250565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.250709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.250853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.251933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.252390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.252556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.252709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.253053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.253206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.253343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.253492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.253669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.254981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.255944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.256996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.257172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.257263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.257347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.257594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.257701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.257965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.258135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.258307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.258555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.258764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.258921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.259097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.259238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.259414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.259592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.259756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.259908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.260033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.260259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.260352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.260602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.260693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.260997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.261972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.262225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.262330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.262542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.262632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.262855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.262947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.263172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.263299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.263487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.263653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.263798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.263966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.264096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.264209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.264406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.264515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.264720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.264832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.265968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.266141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.266310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.266480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.266620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.266761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.266966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.267120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.267269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.267409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.267592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.267741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.267908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.268990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.269168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.269318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.269490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.269625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.269805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.269940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.270150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.270245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.270583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.270685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.270781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.270876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.271109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.271214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.271390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.271482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.271694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.271795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.272981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.273101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.273363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.273607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.273953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.274082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.274287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.274379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.274612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.274750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.274935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.275037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.275277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.275390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.275593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.275698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.275909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.276002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.276270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.276580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.276898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.277072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.277211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.277402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.277531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.277728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.277846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.278127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.278300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.278400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.278483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.278724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.278813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.279046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.279137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.279363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.279444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.279747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.279846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.280011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.280323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.280643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.280968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.281123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.281309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.281430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.281605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.281717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.282074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.282183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.282404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.282499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.282719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.282798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.283035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.283131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.283399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.283509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.283670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.283822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.284967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.285059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.285283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.285405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.285609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.285711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.285926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.286026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.286272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.286373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.286605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.286706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.286925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.287974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.288179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.288270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.288493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.288594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.288896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.289002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.289264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.289441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.289692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.289871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.290015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.290218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.290355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.290532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.290780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.290874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.291101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.291210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.291469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.291737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.291832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.292066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.292171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.292381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.292471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.292699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.292789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.293996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.294122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.294339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.294439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.294650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.294741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.294960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.295069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.295267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.295366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.295575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.295676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.295893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.296984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.297128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.297307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.297434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.297643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.297746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.297980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.298106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.298347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.298437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.298664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.298764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.298976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.299073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.299288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.299378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.299591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.299680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.299915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.300924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.301141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.301241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.301449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.301541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.301760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.301863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.302114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.302208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.302431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.302520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.302762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.302864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.303083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.303173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.303392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.303480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.303723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.303827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.304036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.304206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.304406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.304547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.304879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.305024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.305196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.305403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.305541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.305723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.305878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.306985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.307149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.307286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.307489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.307639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.307859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.308912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.309096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.309223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.309427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.309575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.309752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.309845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.310036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.310269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.310432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.310540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.310714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.310806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.311972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.312988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.313209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.313299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.313538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.313619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.313853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.313994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.314183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.314276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.314494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.314583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.314802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.314905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.315108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.315196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.315472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.315647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.315724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.315796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.316034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.316125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.316445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.316539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.316672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.316772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.317965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.318181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.318307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.318418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.318616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.318726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.318954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.319052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.319260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.319348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.319571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.319679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.319953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.320120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.320416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.320599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.320915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.321008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.321225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.321314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.321534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.321836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.321947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.322203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.322305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.322528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.322614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.322865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.323028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.323201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.323289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.323494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.323580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.323926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.324891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.325114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.325204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.325436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.325534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.325752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.325850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.326087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.326189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.326425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.326508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.326747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.326840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.327078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.327254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.327427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.327600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.327744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.327939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.328029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.328103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.328358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.328500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.328685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.328770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.329057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.329207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.329422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.329569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.329735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.329869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.330038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.330282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.330433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.330611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.330718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.330793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.331047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.331205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.331409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.331560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.331701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.331859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.332908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.333939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.334198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.334304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.334392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.334666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.334774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.334977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.335078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.335294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.335400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.335646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.335747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.336007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.336331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.336423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.336658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.336762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.336995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.337097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.337321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.337435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.337633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.337735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.337951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.338071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.338292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.338384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.338606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.338709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.338913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.339980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.340198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.340290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.340529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.340741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.340835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.341097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.341202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.341417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.341520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.341740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.341840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.342068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.342183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.342384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.342478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.342703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.342794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.343973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.344066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.344291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.344384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.344604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.344757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.344917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.345075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.345235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.345389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.345555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.345713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.345880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.346056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.346217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.346389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.346529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.346699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.346861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.347018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.347209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.347692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.347887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.348919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.349141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.349244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.349452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.349549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.349761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.349851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.350101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.350279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.350439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.350584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.350727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.350876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.351026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.351258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.351474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.351740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.351892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.352128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.352308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.352520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.352692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.352869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.353042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.353186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.353306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.354081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.354252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.354487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.354638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.354793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.354960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.355117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.355258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.355405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.355545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.355699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.355840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.356945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.357755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.358007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.358131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.358391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.358708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.359040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.359378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.359486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.359640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.359722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.359971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.360058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.360299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.360405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.360607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.360753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.360924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.361989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.362240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.362337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.362583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.362685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.362907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.362999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.363224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.363317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.363545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.363637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.363882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.363986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.364207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.364309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.364525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.364618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.364869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.365881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.366112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.366210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.366429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.366542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.366740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.367068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.367275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.367643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.367748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.368981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.369203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.369310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.369545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.369645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.369869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.369972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.370214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.370322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.370525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.370628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.370863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.370958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.371171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.371272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.371513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.371608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.371839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.371947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.372155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.372247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.372472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.372606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.372786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.372947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.373105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.373199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.373422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.373514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.373742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.373845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.374083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.374282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.374489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.374687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.374901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.375968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.376079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.376391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.376630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.376784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.377031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.377184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.377327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.377472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.377708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.377918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.378206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.378409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.378637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.378840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.379202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.379430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.379632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.379860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.380038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.380208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.380374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.380562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.380861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.381105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.381105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.381523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.381677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.381840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.382016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.382407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.382407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.382744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.383005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.383150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.383312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.383597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.383843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.384029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.384225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.384442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.384576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.384775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.385048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.385168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.386094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.386336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.386513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.386662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.386800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.387318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.387567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.387930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.388296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.388519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.388647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.388849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.388981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.389181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.389379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.389514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.389654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.389841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.389981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.390194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.390330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.390521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.390615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116110) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 19:24:51.390849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.391174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.391494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.391812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.392872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.392872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.392872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.393267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.393409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.393735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.394137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.398580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.399279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.399775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.400136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.400480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.400823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.401158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.401491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.401832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.402173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.402996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.402996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.403477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.403477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.403795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.404114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.404427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.404760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.405076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.405622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.405981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.406441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.406778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.407110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.407434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.407749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.408080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.408392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.408701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.409022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.409884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.409884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.410126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.410622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.410941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.411251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.411566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.411875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.412204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.413231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.413231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.413231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.414118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.414118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.414654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.414654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.415080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.415291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.415491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.415811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.416103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.416416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.416719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.417031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.417265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_db.sqlalchemy.engines [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.417461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.417652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.417961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.418687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.418687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.418898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.419217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.419531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.419873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.420226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.420545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.421126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.422193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.422193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.422193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.422526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.422841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.423150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.423472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.423782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.424155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.424404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.424720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.425141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.425418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.425754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.425926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.426250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.426574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.426856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.427202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.427565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.427922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.428240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.428610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.428865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.429176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.429612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.429971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.430263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.430598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.430914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.431225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.431656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.431969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.432290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.432612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.432986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.433741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.433741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.434200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.434200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.434486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.434865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.435123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.435452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.435778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.436095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.436400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.436703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.437014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.437345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.437677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.437993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.438339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.438650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.438972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.439280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.439601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.439921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.440242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.440551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.440881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.441189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.441499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.441807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.442138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.442449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.442759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.443101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.443674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.443674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.444210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.444368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.444608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.444930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.445261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.445589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.445932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.446321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.446635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.446946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.447259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.447574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.447901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.448225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.448550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.448875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.449222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.449535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.449903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.450224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.450536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.450914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.451223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 19 19:24:51.451467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=116111) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 19 19:24:51.475780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_db.sqlalchemy.engines [None req-300b7799-1068-4747-9297-b761139ad709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.589356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.context [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12fc2f6-cd8d-4c14-9fdc-caa783139795(cell1) {{(pid=116110) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 19:24:51.594162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:24:51.596004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:24:51.596894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:24:51.599323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:24:51.610687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_db.sqlalchemy.engines [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.613974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_db.sqlalchemy.engines [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.643880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.context [None req-300b7799-1068-4747-9297-b761139ad709 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c12fc2f6-cd8d-4c14-9fdc-caa783139795(cell1) {{(pid=116111) load_cells /opt/stack/nova/nova/context.py:464}} Nov 19 19:24:51.648471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300b7799-1068-4747-9297-b761139ad709 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:24:51.650270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300b7799-1068-4747-9297-b761139ad709 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:24:51.651098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300b7799-1068-4747-9297-b761139ad709 None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:24:51.653203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300b7799-1068-4747-9297-b761139ad709 None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:24:51.663852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_db.sqlalchemy.engines [None req-300b7799-1068-4747-9297-b761139ad709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.666673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_db.sqlalchemy.engines [None req-300b7799-1068-4747-9297-b761139ad709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.781237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_db.sqlalchemy.engines [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116110) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:51.826806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_db.sqlalchemy.engines [None req-300b7799-1068-4747-9297-b761139ad709 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=116111) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 19 19:24:52.107000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: WARNING keystonemiddleware.auth_token [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:24:52.113589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: WARNING keystonemiddleware.auth_token [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:24:52.149985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: WARNING keystonemiddleware.auth_token [None req-300b7799-1068-4747-9297-b761139ad709 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:24:52.157173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: WARNING keystonemiddleware.auth_token [None req-300b7799-1068-4747-9297-b761139ad709 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:24:52.461921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: WARNING keystonemiddleware.auth_token [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:24:52.467476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: WARNING keystonemiddleware.auth_token [None req-67b87d00-d6f2-4be1-966a-a5ae2ead821d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:24:52.473399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f9c2a5c9c0 pid: 116110 (default app) Nov 19 19:24:52.501164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: WARNING keystonemiddleware.auth_token [None req-300b7799-1068-4747-9297-b761139ad709 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 19 19:24:52.506393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: WARNING keystonemiddleware.auth_token [None req-300b7799-1068-4747-9297-b761139ad709 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 19 19:24:52.511837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55f9c2a5c9c0 pid: 116111 (default app) Nov 19 19:25:27.778397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1718f78-3a58-40fb-a900-fb1ea87ea156 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Action: 'create', calling method: .version_select at 0x7fc149a0f5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2071137859", "metadata": {"Type": "work"}}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:29.332191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1718f78-3a58-40fb-a900-fb1ea87ea156 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.373679 Nov 19 19:25:29.333185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Nov 19 19:25:25 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 3377 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 19:25:29.440974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1015440851", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "17a9eb98-defd-42d9-a91a-58703416466f"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:29.698771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] validate_networks() for [('17a9eb98-defd-42d9-a91a-58703416466f', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:25:29.757180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a1a3f83-7e46-4e5c-bd22-dc0ab5ba0597 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc149a55280>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:30.102614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a1a3f83-7e46-4e5c-bd22-dc0ab5ba0597 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ef462bb5-fc38-412c-9200-eb97f4bfed88" status: 200 len: 350 microversion: 2.1 time: 1.022009 Nov 19 19:25:30.103543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:29 2021] GET /compute/v2.1/os-volumes/ef462bb5-fc38-412c-9200-eb97f4bfed88 => generated 350 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:25:30.113115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bfd19927-91b2-4ee1-8da6-ddff22dd0ea1 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Calling method '.version_select at 0x7fc1499211f0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:30.686752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bfd19927-91b2-4ee1-8da6-ddff22dd0ea1 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9" status: 200 len: 354 microversion: 2.1 time: 0.581998 Nov 19 19:25:30.687839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2/3] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:30 2021] GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9 => generated 354 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:30.703471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-12bde3ec-f742-43ba-ae7f-596f22f3f0d1 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Calling method '.version_select at 0x7fc149921af0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:30.886210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-12bde3ec-f742-43ba-ae7f-596f22f3f0d1 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9" status: 200 len: 354 microversion: 2.1 time: 0.188799 Nov 19 19:25:30.886793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:30 2021] GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9 => generated 354 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:25:30.901347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1e0fb769-dc6a-4483-81eb-c729dc9b1005 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Calling method '.version_select at 0x7fc149921ee0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:31.092516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1e0fb769-dc6a-4483-81eb-c729dc9b1005 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9" status: 202 len: 0 microversion: 2.1 time: 0.195070 Nov 19 19:25:31.093765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 4/5] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Nov 19 19:25:30 2021] DELETE /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:25:31.101681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f030dee8-7d2b-4377-99aa-cb554a76faa8 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Calling method '.version_select at 0x7fc1499218b0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:31.250316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f030dee8-7d2b-4377-99aa-cb554a76faa8 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9" status: 200 len: 353 microversion: 2.1 time: 0.152265 Nov 19 19:25:31.251369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 5/6] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:31 2021] GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:31.916947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-40c1c719-aeb7-4f7c-9f2b-1a0d405b0ac0 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1498dd280>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:32.032897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-40c1c719-aeb7-4f7c-9f2b-1a0d405b0ac0 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/3c02b3f3-6ce8-40e8-90b9-97c8115642a0" status: 200 len: 351 microversion: 2.1 time: 0.122002 Nov 19 19:25:32.040504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 6/7] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:31 2021] GET /compute/v2.1/os-volumes/3c02b3f3-6ce8-40e8-90b9-97c8115642a0 => generated 351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:32.263835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0b2b5263-cf89-4e05-9949-e81bfa0e1f76 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Calling method '.version_select at 0x7fc1499211f0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:32.543827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:25:32.544469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:25:32.544696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:25:32.547247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:25:32.547691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:25:32.580478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:32.580944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:32.581881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:32.582480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:32.627187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-0b2b5263-cf89-4e05-9949-e81bfa0e1f76 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] HTTP exception thrown: Volume 730d6642-dddd-4905-8c6c-fab3cde1fdb9 could not be found. Nov 19 19:25:32.628348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0b2b5263-cf89-4e05-9949-e81bfa0e1f76 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] Returning 404 to user: Volume 730d6642-dddd-4905-8c6c-fab3cde1fdb9 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:32.629391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0b2b5263-cf89-4e05-9949-e81bfa0e1f76 tempest-VolumesGetTestJSON-932999218 tempest-VolumesGetTestJSON-932999218-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9" status: 404 len: 109 microversion: 2.1 time: 0.370037 Nov 19 19:25:32.630141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 7/8] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:32 2021] GET /compute/v2.1/os-volumes/730d6642-dddd-4905-8c6c-fab3cde1fdb9 => generated 109 bytes in 371 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 19:25:32.680066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Getting quotas for project 34b4455324c0486da550c1ffdb506a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:32.714228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Getting quotas for user 3e4de778d2f54a44a174d8bfe7580289 and project 34b4455324c0486da550c1ffdb506a1c. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:32.731840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:25:32.744891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:25:32.972648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-35f01a3a-bdf3-4cfc-b4a6-9ddfb9f16fff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.637737 Nov 19 19:25:32.974750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2/9] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:25:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 3641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:25:32.987192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4eb41d36-17d4-4979-8bce-43b65c502cad tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:32.988473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4eb41d36-17d4-4979-8bce-43b65c502cad tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:33.297087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4eb41d36-17d4-4979-8bce-43b65c502cad tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:33.327555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4eb41d36-17d4-4979-8bce-43b65c502cad tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1215 microversion: 2.1 time: 0.345607 Nov 19 19:25:33.328621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 8/10] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:32 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1215 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:34.355862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbc2c26a-3053-455a-a281-904b5f5cd4f5 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:34.358689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbc2c26a-3053-455a-a281-904b5f5cd4f5 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:34.998187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bbc2c26a-3053-455a-a281-904b5f5cd4f5 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:35.029800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbc2c26a-3053-455a-a281-904b5f5cd4f5 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1215 microversion: 2.1 time: 0.687597 Nov 19 19:25:35.032939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 3/11] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:34 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1215 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:36.062475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:36.064368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:36.088168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:36.092720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:36.094266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:36.097840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:36.340023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00e3e0e0-8f9b-4e7d-9bdd-6bead44cdb6b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'create', calling method: .version_select at 0x7fc148795b80>, body: {"keypair": {"name": "tempest-keypair-562443595"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:36.387935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-00e3e0e0-8f9b-4e7d-9bdd-6bead44cdb6b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:36.399227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-00e3e0e0-8f9b-4e7d-9bdd-6bead44cdb6b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for user 5416c05854a84428a3253dc8f373dce3 and project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:36.528472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:36.562313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c4713577-de2f-478f-96cb-f9eb0a5b3a06 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1219 microversion: 2.1 time: 0.515697 Nov 19 19:25:36.565624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 9/12] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:36 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1219 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:36.783353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-00e3e0e0-8f9b-4e7d-9bdd-6bead44cdb6b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:36.792047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-00e3e0e0-8f9b-4e7d-9bdd-6bead44cdb6b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for user 5416c05854a84428a3253dc8f373dce3 and project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:36.825881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00e3e0e0-8f9b-4e7d-9bdd-6bead44cdb6b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.682459 Nov 19 19:25:36.827066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 4/13] 10.222.0.46 () {62 vars in 1198 bytes} [Fri Nov 19 19:25:36 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 684 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 19:25:37.245858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5161e6ca-f93b-49a9-afbc-d59bae4a09c0 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc14981d8b0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:37.359894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5161e6ca-f93b-49a9-afbc-d59bae4a09c0 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4ec46c7b-ed47-4765-b4d3-c9f09d3731f5" status: 200 len: 351 microversion: 2.1 time: 0.117737 Nov 19 19:25:37.360919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 10/14] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:37 2021] GET /compute/v2.1/os-volumes/4ec46c7b-ed47-4765-b4d3-c9f09d3731f5 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:37.372340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b7542621-b319-4637-9232-5d51cde49437 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1487aa700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:37.582433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:37.583154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:37.598627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:37.600844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:37.607150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:37.613068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:37.627236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b7542621-b319-4637-9232-5d51cde49437 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.258819 Nov 19 19:25:37.628908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 5/15] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Nov 19 19:25:37 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:37.641041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-355b6679-6795-4628-a292-6cc3c21ecb44 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1487571f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:37.867316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-355b6679-6795-4628-a292-6cc3c21ecb44 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.229797 Nov 19 19:25:37.868667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 6/16] 10.222.0.46 () {58 vars in 1148 bytes} [Fri Nov 19 19:25:37 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:25:37.895074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d76d1eeb-7a52-4daf-a2d7-76d69ab2fa90 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1487590d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:38.098263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d76d1eeb-7a52-4daf-a2d7-76d69ab2fa90 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.213522 Nov 19 19:25:38.098864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 7/17] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Nov 19 19:25:37 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:25:38.157777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:38.166350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dce07aec-9ee0-4d68-b237-8e553a752f32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1275 microversion: 2.1 time: 0.587880 Nov 19 19:25:38.174116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 11/18] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:37 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1275 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:38.181947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a32048a-0aac-4a3a-a5ee-f30e1652ba90 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1498328b0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:38.515199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a32048a-0aac-4a3a-a5ee-f30e1652ba90 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.339811 Nov 19 19:25:38.516038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 12/19] 10.222.0.46 () {58 vars in 1166 bytes} [Fri Nov 19 19:25:38 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:38.529361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-211db7a2-5c50-4c6f-8c47-a478e79aaf45 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc149844820>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:38.776527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-629189519", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50b276c1-e186-4458-bab6-e143553f7fea"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:38.913575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-211db7a2-5c50-4c6f-8c47-a478e79aaf45 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.387977 Nov 19 19:25:38.914326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 13/20] 10.222.0.46 () {58 vars in 1169 bytes} [Fri Nov 19 19:25:38 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:25:38.956605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] validate_networks() for [('50b276c1-e186-4458-bab6-e143553f7fea', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:25:39.118874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11c8cfd8-2ad1-4de6-8277-28f1b43728f1 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Action: 'create', calling method: .version_select at 0x7fc1498448b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1560161010", "metadata": {"Type": "work"}}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:39.120778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11c8cfd8-2ad1-4de6-8277-28f1b43728f1 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:39.121795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11c8cfd8-2ad1-4de6-8277-28f1b43728f1 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.206355 Nov 19 19:25:39.122584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 14/21] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Nov 19 19:25:38 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 208 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:25:39.140104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f35b140-57f1-4653-9ccd-127151402380 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc149921f70>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:39.485785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f35b140-57f1-4653-9ccd-127151402380 tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.361508 Nov 19 19:25:39.486702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 15/22] 10.222.0.46 () {58 vars in 1154 bytes} [Fri Nov 19 19:25:39 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:39.492505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1bcbb4f-35ed-405a-acb7-e94a4ab779a1 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Action: 'create', calling method: .version_select at 0x7fc1498324c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-366998911", "metadata": {"Type": "work"}}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:39.496673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1bcbb4f-35ed-405a-acb7-e94a4ab779a1 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:39.497515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1bcbb4f-35ed-405a-acb7-e94a4ab779a1 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009711 Nov 19 19:25:39.516403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 16/23] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Nov 19 19:25:39 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:25:39.530159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:39.534086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:39.552464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:39.555989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:39.565284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:39.565885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:40.021929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:40.042576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-484e0c9d-3c11-4682-a9dd-7a28954204cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1273 microversion: 2.1 time: 0.514327 Nov 19 19:25:40.045762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 17/24] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:39 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1273 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:40.069085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c57924e0-6caf-4246-83a8-2963b331616d tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1497e08b0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:40.300280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c57924e0-6caf-4246-83a8-2963b331616d tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.242871 Nov 19 19:25:40.300892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 18/25] 10.222.0.46 () {58 vars in 1187 bytes} [Fri Nov 19 19:25:40 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:40.305595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0dc6e086-c02a-49ed-824f-e3a68976d058 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Action: 'create', calling method: .version_select at 0x7fc1497f8160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-780246988", "metadata": {"Type": "work"}}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:40.306888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0dc6e086-c02a-49ed-824f-e3a68976d058 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:40.307667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0dc6e086-c02a-49ed-824f-e3a68976d058 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.005887 Nov 19 19:25:40.317171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 19/26] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Nov 19 19:25:40 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:25:40.335022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb1cf57f-22c2-4875-a877-d5955992a1db tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] Calling method '.version_select at 0x7fc1497978b0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:40.563815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb1cf57f-22c2-4875-a877-d5955992a1db tempest-VolumesTestJSON-149178571 tempest-VolumesTestJSON-149178571-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.245420 Nov 19 19:25:40.576741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 20/27] 10.222.0.46 () {58 vars in 1154 bytes} [Fri Nov 19 19:25:40 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:40.582217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c5ce80a-5d06-4e43-8df4-34d7007cfdb6 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Calling method '.version_select at 0x7fc1497f8d30>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:41.083159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-5c5ce80a-5d06-4e43-8df4-34d7007cfdb6 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] HTTP exception thrown: Volume tempest-invalid-892733627 could not be found. Nov 19 19:25:41.084051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c5ce80a-5d06-4e43-8df4-34d7007cfdb6 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Returning 404 to user: Volume tempest-invalid-892733627 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:41.085952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c5ce80a-5d06-4e43-8df4-34d7007cfdb6 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-892733627" status: 404 len: 98 microversion: 2.1 time: 0.507508 Nov 19 19:25:41.087604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 21/28] 10.222.0.46 () {58 vars in 1214 bytes} [Fri Nov 19 19:25:40 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-892733627 => generated 98 bytes in 510 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 19 19:25:41.093043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:41.095980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:41.131352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:41.132972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:41.136035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:41.139944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:41.272181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:25:41.272727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:25:41.273278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:25:41.273755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:25:41.274356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:25:41.286458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:41.287978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:41.291634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:41.292322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:41.323915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Getting quotas for project ffc5b6a5df1040c9849b724924b751bd. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:41.337512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:41.349492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ade4c04-b9ea-4454-bddf-a4268680ed8a tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1273 microversion: 2.1 time: 0.260550 Nov 19 19:25:41.364586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 22/29] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:41 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:41.364914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Getting quotas for user bc51618f63694c8bab3ab1ea8ce03c1f and project ffc5b6a5df1040c9849b724924b751bd. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:41.380343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-77ccb4f2-724d-477e-9bc6-119228e8b6a8 tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013546 Nov 19 19:25:41.383027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 23/30] 10.222.0.46 () {58 vars in 1139 bytes} [Fri Nov 19 19:25:41 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 19:25:41.401854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ececabe3-7ec4-44d1-a90e-d4b1dbdedb0c tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012746 Nov 19 19:25:41.406704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 24/31] 10.222.0.46 () {58 vars in 1136 bytes} [Fri Nov 19 19:25:41 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 19 19:25:41.415456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:25:41.422746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5acabac7-083a-4121-a249-5848c6e13ded tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Calling method '.version_select at 0x7fc1497e0f70>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:41.425847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:25:41.542378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2a362425-a15d-4873-8363-2e72c7920cca tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.440543 Nov 19 19:25:41.553769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-5acabac7-083a-4121-a249-5848c6e13ded tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] HTTP exception thrown: Volume d8ede303-6283-4745-9df1-8be416da9bc5 could not be found. Nov 19 19:25:41.554676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5acabac7-083a-4121-a249-5848c6e13ded tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Returning 404 to user: Volume d8ede303-6283-4745-9df1-8be416da9bc5 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:41.555745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5acabac7-083a-4121-a249-5848c6e13ded tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/d8ede303-6283-4745-9df1-8be416da9bc5" status: 404 len: 109 microversion: 2.1 time: 0.141439 Nov 19 19:25:41.556797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 25/32] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Nov 19 19:25:41 2021] DELETE /compute/v2.1/os-volumes/d8ede303-6283-4745-9df1-8be416da9bc5 => generated 109 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:25:41.558590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 8/33] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:25:38 2021] POST /compute/v2.1/servers => generated 383 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:25:41.567515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0925df39-d162-4d9e-afa0-da2c17c77afd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:41.570614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0925df39-d162-4d9e-afa0-da2c17c77afd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:41.579707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79a1b89b-61dd-4cf4-997a-dc6a557bc59c tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Calling method '.version_select at 0x7fc148746ee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:41.663075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-79a1b89b-61dd-4cf4-997a-dc6a557bc59c tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] HTTP exception thrown: Volume 343cd045-9ef5-4814-b93b-a5b91bcd6634 could not be found. Nov 19 19:25:41.664324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79a1b89b-61dd-4cf4-997a-dc6a557bc59c tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] Returning 404 to user: Volume 343cd045-9ef5-4814-b93b-a5b91bcd6634 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:25:41.665750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79a1b89b-61dd-4cf4-997a-dc6a557bc59c tempest-VolumesNegativeTest-1906445311 tempest-VolumesNegativeTest-1906445311-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/343cd045-9ef5-4814-b93b-a5b91bcd6634" status: 404 len: 109 microversion: 2.1 time: 0.098485 Nov 19 19:25:41.666927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 9/34] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 19:25:41 2021] GET /compute/v2.1/os-volumes/343cd045-9ef5-4814-b93b-a5b91bcd6634 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:25:41.715989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0925df39-d162-4d9e-afa0-da2c17c77afd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:41.724055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0925df39-d162-4d9e-afa0-da2c17c77afd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1221 microversion: 2.1 time: 0.166003 Nov 19 19:25:41.743586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 26/35] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:41.944985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-557204709", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "50b276c1-e186-4458-bab6-e143553f7fea"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:42.190641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] validate_networks() for [('50b276c1-e186-4458-bab6-e143553f7fea', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:25:42.372729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:42.373624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:42.394440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:42.395475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:42.396621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:42.397309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:44.783312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:44.808281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8f02942f-9aa5-4888-ab2d-990db21e17cf tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 2.440669 Nov 19 19:25:44.808908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 27/36] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:42 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 2442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:44.973155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-562981861", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb3bf421-2641-4240-bd79-b0e181858287"}], "security_groups": [{"name": "tempest-securitygroup--456656361"}], "key_name": "tempest-keypair-562443595", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:45.980754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] validate_networks() for [('bb3bf421-2641-4240-bd79-b0e181858287', None, None, None, None, None)] {{(pid=116111) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:25:46.734367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:25:46.735646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:25:46.736462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:25:46.737291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:25:46.737849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:25:46.770469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:46.771236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:46.773139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:46.775973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:46.882182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Getting quotas for project ffc5b6a5df1040c9849b724924b751bd. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:46.898392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Getting quotas for user bc51618f63694c8bab3ab1ea8ce03c1f and project ffc5b6a5df1040c9849b724924b751bd. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:46.954421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:25:46.965068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:25:47.132756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5c1fe0b-b861-4082-81a0-7fa86846e88c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.198742 Nov 19 19:25:47.148678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 10/37] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:25:41 2021] POST /compute/v2.1/servers => generated 383 bytes in 5215 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:25:47.779870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2adf13ab-c259-4952-ad46-9b8bb102f15c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: .version_select at 0x7fc148746a60>, body: {"keypair": {"name": "tempest-keypair-742200303"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:47.818180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-2adf13ab-c259-4952-ad46-9b8bb102f15c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:47.823006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-2adf13ab-c259-4952-ad46-9b8bb102f15c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for user ce68124c60ff4f6a820dc3a04630663a and project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:48.094607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-2adf13ab-c259-4952-ad46-9b8bb102f15c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:48.100255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-2adf13ab-c259-4952-ad46-9b8bb102f15c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for user ce68124c60ff4f6a820dc3a04630663a and project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:48.121631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2adf13ab-c259-4952-ad46-9b8bb102f15c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.968515 Nov 19 19:25:48.124098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 11/38] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Nov 19 19:25:47 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:48.132271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:48.134295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:48.149562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:48.150445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:48.151472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:48.152690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:48.923372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:48.972540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Flavor limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:25:48.973151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Image limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:25:48.973434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Flavor pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:25:48.973841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Image pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:25:48.974455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:25:48.976783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-604edac6-35f2-4e25-bf4a-b29d6b7e82ce tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.848408 Nov 19 19:25:48.977953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 12/39] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:48 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:48.987426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:48.992972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:49.010306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.013329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.013945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.014644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.016764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.019270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.022319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.023110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.137160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:49.150019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for user 5416c05854a84428a3253dc8f373dce3 and project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:49.165929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Going to run 1 instances... {{(pid=116111) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:25:49.169934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:25:49.173420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:49.185186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7192aea1-866f-4d46-a7e7-73d16f8c77d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1225 microversion: 2.1 time: 0.202867 Nov 19 19:25:49.185969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 13/40] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:48 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1225 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:49.384732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32bbc27c-c120-41c9-aac8-0c08a4c1f75a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.417395 Nov 19 19:25:49.390259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 28/41] 10.222.0.46 () {62 vars in 1187 bytes} [Fri Nov 19 19:25:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 4420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 19 19:25:49.397327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d4289680-85eb-41af-8166-78558365cf3d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:49.398236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d4289680-85eb-41af-8166-78558365cf3d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:49.481547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d4289680-85eb-41af-8166-78558365cf3d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:49.497295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-82e1e8dd-93c5-4654-b731-459ed8aaeb1f req-46d88145-3e82-4fd3-be1c-e4f5d03055ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23a7238b-b950-4888-8520-304208919484", "tag": "45987cad-60cd-4af0-b3cb-efd5455d5a34"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:49.500536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:25:49.500536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:25:49.507672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d4289680-85eb-41af-8166-78558365cf3d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:49.518086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d4289680-85eb-41af-8166-78558365cf3d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:49.520650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d4289680-85eb-41af-8166-78558365cf3d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1280 microversion: 2.20 time: 0.128221 Nov 19 19:25:49.531392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-82e1e8dd-93c5-4654-b731-459ed8aaeb1f req-46d88145-3e82-4fd3-be1c-e4f5d03055ad service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.531829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-82e1e8dd-93c5-4654-b731-459ed8aaeb1f req-46d88145-3e82-4fd3-be1c-e4f5d03055ad service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.536583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 29/42] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1280 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:25:49.571092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-82e1e8dd-93c5-4654-b731-459ed8aaeb1f req-46d88145-3e82-4fd3-be1c-e4f5d03055ad service nova] Creating event network-changed:45987cad-60cd-4af0-b3cb-efd5455d5a34 for instance 23a7238b-b950-4888-8520-304208919484 on hv-cinder-77703 Nov 19 19:25:49.571875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-82e1e8dd-93c5-4654-b731-459ed8aaeb1f req-46d88145-3e82-4fd3-be1c-e4f5d03055ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=116110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 19:25:49.573441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.574239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.575262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:49.576024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:49.594993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.compute.rpcapi [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 19:25:49.596332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] Releasing lock "compute-rpcapi-router" {{(pid=116110) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 19:25:49.681262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d46fc7db-f7e1-4e1c-a826-07ebd2cb23ee None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.490836 Nov 19 19:25:49.683184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 14/43] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:25:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:25:50.008494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:50.009124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:50.016999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:50.020159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:50.021610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:50.022319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:50.207079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:50.209482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:50.236575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:50.239140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:50.241606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:50.242502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:50.618714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:50.661159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5494f6c0-acf3-4dda-baea-c7934ed9d935 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1225 microversion: 2.1 time: 0.427794 Nov 19 19:25:50.671177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 15/44] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:50 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1225 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:50.679039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:50.681012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:50.689539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:50.694958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:50.695755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:50.697117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:50.697756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:50.698884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da7c2440-c5d6-4655-8605-ce9443712bdd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.708680 Nov 19 19:25:50.714215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 30/45] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:49 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:50.777599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:50.793376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:50.798349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:50.803449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48b707fb-5391-45d8-bbca-632b703b7434 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1284 microversion: 2.20 time: 0.129206 Nov 19 19:25:50.814437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 16/46] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:51.698780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:51.698780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:51.722849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:51.723713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:51.739213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:51.740912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:51.741881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:51.742512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:51.756600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:51.757237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:51.758297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:51.759030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:52.283296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:52.307679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-81a65e9b-f206-4971-96db-697302fc1af4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1217 microversion: 2.1 time: 0.629975 Nov 19 19:25:52.310834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 31/47] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:51 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1217 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:52.324506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:52.330675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:52.356419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:52.361238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:52.365318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:52.365318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:52.888245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:52.909973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:52.912164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:52.922212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be9d225d-0552-4773-8156-82e11f7924c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1276 microversion: 2.20 time: 0.608096 Nov 19 19:25:52.926425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 32/48] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1276 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:53.328675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:53.329641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:53.345726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:53.347491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:53.348426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:53.350281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:53.418235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:53.425722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20c9665b-349d-4d7c-8cc9-d493a0679a32 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 1.707393 Nov 19 19:25:53.434611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 17/49] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:51 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:25:53.439914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1324023987", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2006e30f-6f7d-4222-b3ea-0cb7cc3e862e"}], "security_groups": [{"name": "tempest-securitygroup--1833606038"}], "key_name": "tempest-keypair-742200303", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:25:53.831961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] validate_networks() for [('2006e30f-6f7d-4222-b3ea-0cb7cc3e862e', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:25:53.837857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:53.848593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ced9e570-eb10-4127-a961-9fb4ea9d72d7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.524045 Nov 19 19:25:53.854899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 33/50] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:53 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:53.941717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:53.943638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:53.953685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:53.954432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:53.955876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:53.956518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.039455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:54.048186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:54.050563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:54.051739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af88fcdf-ecc9-46da-b0a6-e55fc4916e69 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.114134 Nov 19 19:25:54.052328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 34/51] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:54.414602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:25:54.415025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:25:54.415468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:25:54.415869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:25:54.416271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:25:54.426123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:54.426715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.427285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:54.427819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.442138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:54.443026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:54.449193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for project f6c9eacf55bb437da4631e3110651320. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:25:54.451490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:54.452093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.453078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:54.453780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.455601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for user ce68124c60ff4f6a820dc3a04630663a and project f6c9eacf55bb437da4631e3110651320. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:25:54.469744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:25:54.472555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:25:54.528269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bf16c268-4a0d-4a99-a695-488ad8822e5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.092451 Nov 19 19:25:54.529039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 18/52] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:25:53 2021] POST /compute/v2.1/servers => generated 402 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:25:54.541178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eda37676-78a6-4c22-8d5f-8202f3a79e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:54.541810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eda37676-78a6-4c22-8d5f-8202f3a79e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:54.606884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:54.618027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-329ed99b-e310-4740-a4c7-bf7491f87d4b tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.179219 Nov 19 19:25:54.619250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 35/53] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:54 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:25:54.645171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eda37676-78a6-4c22-8d5f-8202f3a79e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:54.655576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eda37676-78a6-4c22-8d5f-8202f3a79e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1237 microversion: 2.1 time: 0.119465 Nov 19 19:25:54.656338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 19/54] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1237 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:54.867559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:54.868198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:54.875178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:54.876187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.877494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:54.878106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:54.963591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:54.972175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04b99db2-8829-45e6-a0d0-d4cb9a091b60 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.109412 Nov 19 19:25:54.982322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 36/55] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:54 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:55.069400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:55.070014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:55.076156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.076603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.077384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.077838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.139389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:55.152301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:55.153791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:55.154930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96a71be5-d42f-43f6-9be6-c5f6b080b1f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.089448 Nov 19 19:25:55.155490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 20/56] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:55.636221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:55.636993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:55.643292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.643746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.644568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.645018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.673843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:55.674722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:55.691209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.691674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.692483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.692924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.768139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:55.776465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d524d3c1-dc48-48cb-9e36-72c453d389d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1241 microversion: 2.1 time: 0.107145 Nov 19 19:25:55.786227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 21/57] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:55.809948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:55.817509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4c944826-1b75-4c9d-82ad-503db3fd41bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.185008 Nov 19 19:25:55.818161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 37/58] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:55 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:55.990881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:55.991481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:55.997979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:55.998755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:55.999777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.000257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.063973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:56.072123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6df2f323-f415-4a27-acc8-c3f02191f717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.085913 Nov 19 19:25:56.072918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 22/59] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:55 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:56.172567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:56.173169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:56.180740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.181157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.182153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.182748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.244642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:56.253004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:56.254522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:56.255843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b2164b2-d57d-490e-9605-100d459210d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.086892 Nov 19 19:25:56.256729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 38/60] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:56.793116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:56.793778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:56.800502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.800971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.801744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.802231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.843738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:56.846116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:56.864073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.864527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.865504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:56.868064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:56.891120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:56.900111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d9135982-1a66-4049-bd32-b6db6582b6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1241 microversion: 2.1 time: 0.110698 Nov 19 19:25:56.900713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 23/61] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:57.016724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:57.024869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6542140-8e8b-433a-99df-35563ba15d7c tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.193495 Nov 19 19:25:57.025479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 39/62] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:56 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:25:57.089335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:57.089918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:57.097247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:57.097785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:57.098680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:57.099165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:57.165943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:57.182196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f0c977d-a981-4682-95e0-5617dead563e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.096806 Nov 19 19:25:57.183029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 24/63] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:57 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:25:57.285211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:57.290921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:57.304628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:57.305702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:57.306893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:57.307581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:57.452758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:57.465900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:57.467481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:57.468661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2c819b11-c6e6-43bd-9361-b1fa07a01c26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.194843 Nov 19 19:25:57.469196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 40/64] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:57.923730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:57.924471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:57.931099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:57.931548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:57.932382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:57.932820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.024815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:58.032452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14edd575-01fb-44db-b2fd-80e57b766561 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1241 microversion: 2.1 time: 0.116507 Nov 19 19:25:58.033131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 25/65] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:57 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:58.041843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:58.042494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:58.048949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:58.049643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.051190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:58.051320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.205238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:58.205854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:58.214472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:58.215297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.216475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:58.216903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.229559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:58.238938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e3aa2464-7bcc-4302-9b31-08b5fc531893 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.200602 Nov 19 19:25:58.240146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 41/66] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:58 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:58.291988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:58.299422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ae6aec3-3ee7-4caa-b50c-4deb216700d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.098203 Nov 19 19:25:58.299992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 26/67] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:58 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:58.490712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:58.491470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:58.497698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:58.498183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.498968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:58.499412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:58.705062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:58.715196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:58.717141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:58.718459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9e995bcb-9176-42b3-936b-88c42156eb35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.231820 Nov 19 19:25:58.719524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 42/68] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:25:59.051461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:59.053305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:59.060638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.061213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.062082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.062759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.128035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:59.135938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-51f51888-100c-477c-bf8c-bfd1d26eae48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1241 microversion: 2.1 time: 0.088450 Nov 19 19:25:59.136782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 27/69] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:59.256542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:59.257266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:59.263108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.263552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.264319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.264744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.316619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:59.317696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:59.324756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.325203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.325994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.326457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.401190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:59.408844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be6eec13-e757-48ce-8d85-8d8580764540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.096236 Nov 19 19:25:59.409427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 28/70] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:59 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:25:59.431069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:59.438680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f9f41148-815c-4746-995d-90857fcaa687 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.185916 Nov 19 19:25:59.439373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 43/71] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:25:59 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:25:59.738838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:25:59.739480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:25:59.745411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.747494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.747494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:25:59.747494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:25:59.816206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:59.824924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:59.826431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:25:59.827570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2d85b7c2-aa16-42dc-91f6-3243a7fc0e19 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.092702 Nov 19 19:25:59.828133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 29/72] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:25:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:00.153064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:00.153770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:00.159698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.160143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.160991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.161427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.236074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:00.249333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8644277-cfb7-4a92-a862-44de1dce3b95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1241 microversion: 2.1 time: 0.099794 Nov 19 19:26:00.250132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 44/73] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1241 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:00.425529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:00.426732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:00.433330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.433792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.434592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.435046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.456231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:00.457105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:00.463643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.464061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.465001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.465569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.499787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:00.507786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3cb8bb9f-d646-417c-8665-fa77e44706a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.085867 Nov 19 19:26:00.508734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 30/74] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:00 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:00.606569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:00.614217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b81d06f8-674f-4df8-a43d-fc6b37b76541 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.162058 Nov 19 19:26:00.614883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 45/75] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:00 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:00.845682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:00.846271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:00.852740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.853194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.853978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:00.854445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:00.916512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:00.924947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:00.926741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:00.931589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f63bf4ea-b206-4424-a837-63d0b47d50e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.086044 Nov 19 19:26:00.931589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 31/76] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:01.267032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:01.267657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:01.274766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.275315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.275989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.276448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.339556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:01.347880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b275003-f984-4dcc-b3f6-7c4199beb933 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1241 microversion: 2.1 time: 0.084367 Nov 19 19:26:01.348408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 46/77] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:01.524554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:01.525119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:01.533609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.534233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.535079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.535532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.601310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:01.609408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3a9aca0f-267d-496b-bf59-32fbf506e5df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1281 microversion: 2.1 time: 0.088550 Nov 19 19:26:01.610102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 32/78] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:01 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:01.634177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:01.634954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:01.643046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.645549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.647084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.648695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.955337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:01.956225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:01.982667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:01.983379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:01.999616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:02.002341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:02.202105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:02.211373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:02.212882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:02.214925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ddbe4843-e2dc-4af6-8eec-7383d6841e42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1332 microversion: 2.20 time: 0.268191 Nov 19 19:26:02.222377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 33/79] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1332 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:02.297055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:02.309268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-acb974ea-3764-4e98-8941-6363fcdf9515 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.680143 Nov 19 19:26:02.314523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 47/80] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:01 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:02.365917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:02.366580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:02.374998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:02.376595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:02.377418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:02.377885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:02.559915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:02.580742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76b942a2-49a6-438b-8047-2d5076ec0c2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1289 microversion: 2.1 time: 0.219543 Nov 19 19:26:02.595967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 34/81] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1289 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:02.630708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:02.632833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:02.643854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:02.644717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:02.648006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:02.648597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:02.770352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:02.783256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39105aa4-f29b-4d10-900c-42c12e4bdf2a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1279 microversion: 2.1 time: 0.160244 Nov 19 19:26:02.784522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 48/82] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:02 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1279 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:03.244425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:03.245365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:03.259191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.259707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.260498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.261097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.337577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:03.339034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:03.353650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.355357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.356696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.357518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.373873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:03.384199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:03.385978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:03.387538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c69ab88f-7b60-4669-ade7-efdce2e3ef3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1338 microversion: 2.20 time: 0.148708 Nov 19 19:26:03.388601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 35/83] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1338 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:03.603547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:03.605803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:03.612859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.613981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.615600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.616263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.815608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:03.832189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-94159553-aab6-4399-ab77-2a85364d9e05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1295 microversion: 2.1 time: 0.231834 Nov 19 19:26:03.833637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 36/84] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:03 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1295 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:03.843682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:03.844615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:03.869720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.871225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.876416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:03.879367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:03.924586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:03.939901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de02f3e7-7cdd-4971-9738-ef80f4a243d9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.610237 Nov 19 19:26:03.940498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 49/85] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:03 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:04.179381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-3b9f087c-0bec-4aa8-962d-1bae89957f63 req-807ffa7e-df1a-4d85-9bf9-651021e0e09f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d879d4cd-e7fb-4405-a218-e89955a7405c", "tag": "512afcb1-3817-4353-9942-5484dcaeeb5f"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:04.181949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:04.181949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:26:04.200684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3b9f087c-0bec-4aa8-962d-1bae89957f63 req-807ffa7e-df1a-4d85-9bf9-651021e0e09f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.201349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3b9f087c-0bec-4aa8-962d-1bae89957f63 req-807ffa7e-df1a-4d85-9bf9-651021e0e09f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.232495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-3b9f087c-0bec-4aa8-962d-1bae89957f63 req-807ffa7e-df1a-4d85-9bf9-651021e0e09f service nova] Creating event network-changed:512afcb1-3817-4353-9942-5484dcaeeb5f for instance d879d4cd-e7fb-4405-a218-e89955a7405c on hv-cinder-77703 Nov 19 19:26:04.233076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3b9f087c-0bec-4aa8-962d-1bae89957f63 req-807ffa7e-df1a-4d85-9bf9-651021e0e09f service nova] Acquired lock "compute-rpcapi-router" {{(pid=116111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 19 19:26:04.234347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.235130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.236310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.237007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.248468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.compute.rpcapi [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] Automatically selected compute RPC version 6.0 from minimum service version 60 Nov 19 19:26:04.249689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] Releasing lock "compute-rpcapi-router" {{(pid=116111) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 19 19:26:04.292128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4a75a71f-6d2f-4c34-864d-2c18cdb68c9f None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116591 Nov 19 19:26:04.293481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 50/86] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:26:04.407083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:04.408481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:04.415696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.416147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.416942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.417377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.457594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:04.467820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-054d1537-bb2a-4b0b-9827-c435d3800e52 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.632386 Nov 19 19:26:04.468682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 37/87] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:03 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:04.572298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:04.581517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:04.583066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:04.585695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b9eb681c-89dd-4e51-978e-5906ce3284f2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1338 microversion: 2.20 time: 0.183034 Nov 19 19:26:04.587323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 51/88] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1338 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:26:04.851314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:04.851934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:04.858346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.859183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.859992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.860432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.957119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-661ba5ef-1d86-47ac-a286-d894a941bc98 req-c77ecb7a-7859-4b70-ade3-364d07dd7b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38904995-d04e-4db1-93b4-52153ee2c2e2", "tag": "610b92c9-51b5-4f46-ae92-d11988ba413e"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:04.958964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:04.958964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:26:04.972137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-661ba5ef-1d86-47ac-a286-d894a941bc98 req-c77ecb7a-7859-4b70-ade3-364d07dd7b66 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:04.972137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-661ba5ef-1d86-47ac-a286-d894a941bc98 req-c77ecb7a-7859-4b70-ade3-364d07dd7b66 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:04.988704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:05.001766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-661ba5ef-1d86-47ac-a286-d894a941bc98 req-c77ecb7a-7859-4b70-ade3-364d07dd7b66 service nova] Creating event network-changed:610b92c9-51b5-4f46-ae92-d11988ba413e for instance 38904995-d04e-4db1-93b4-52153ee2c2e2 on hv-cinder-77703 Nov 19 19:26:05.013857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-661ba5ef-1d86-47ac-a286-d894a941bc98 req-c77ecb7a-7859-4b70-ade3-364d07dd7b66 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146463 Nov 19 19:26:05.015859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 52/89] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:05.017000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9846d499-fa0e-46d9-a570-601432236646 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1295 microversion: 2.1 time: 0.169948 Nov 19 19:26:05.028392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 38/90] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1295 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:05.028765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:05.030706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:05.045102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:05.045972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:05.047258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:05.047909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:05.293150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:05.302588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f1f700d0-e60a-4cc1-a8a1-2aaaab097eca tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.282798 Nov 19 19:26:05.303157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 53/91] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:05 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:05.485835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:05.486621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:05.492739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:05.493224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:05.494007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:05.494454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:05.604722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:05.605319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:05.624742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:05.625692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:05.626572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:05.627291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:05.636626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:05.644706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e32009c-2eb3-44b9-8ed1-e57cac4defb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.162473 Nov 19 19:26:05.645294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 39/92] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:05 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:05.930462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:05.938363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:05.939804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:05.940895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61c1215f-2201-4b1b-9ece-f64674bfe12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.340254 Nov 19 19:26:05.941453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 54/93] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:26:06.035235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:06.035866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:06.042467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.042907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.043682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.044107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.176852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:06.184379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b374466b-20e5-4a04-a093-c25b5abdc5e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.152780 Nov 19 19:26:06.184950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 40/94] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:06 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:06.320006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:06.320509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:06.327023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.327471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.328245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.328674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.468913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:06.477406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fc0e3f0c-8347-4d89-972a-c2c97a1a8291 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.161406 Nov 19 19:26:06.477988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 55/95] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:06 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:06.662896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:06.663408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:06.669947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.670427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.671199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.671630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.810353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:06.818298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d1906e8-e6ef-4faf-8cdc-cc305fcbdd47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.159234 Nov 19 19:26:06.819171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 41/96] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:06 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:06.960277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:06.960840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:06.967326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.967770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:06.968551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:06.968980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:07.104192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:07.112382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:07.113864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:07.115638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b681f3d5-1751-4ec9-b20d-01dcdd5f6229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.159083 Nov 19 19:26:07.116217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 56/97] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:07.201759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:07.202409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:07.212762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:07.213325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:07.214239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:07.214680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:07.353512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:07.361275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b8766571-fceb-4f30-93fc-0506ff98d594 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.163121 Nov 19 19:26:07.361856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 42/98] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:07.495207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:07.495907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:07.502782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:07.503231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:07.504006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:07.504434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:07.642952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:07.650983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-107b2c86-26f9-4a69-b16c-0b7ba4b8b7d6 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.159889 Nov 19 19:26:07.651551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 57/99] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:07 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:07.836221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:07.836823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:07.843281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:07.843728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:07.844500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:07.844927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.114199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:08.122980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ec3ab2f9-f599-41c7-be75-d8119693c8e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.290471 Nov 19 19:26:08.123657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 43/100] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:07 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:08.138844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:08.139618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:08.148281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:08.149080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.150300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:08.150739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.379296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:08.380648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:08.393530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:08.393974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.394814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:08.395246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.769078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:08.778674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:08.780203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:08.781548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67895b6a-338a-451b-942a-335f969a271f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.647653 Nov 19 19:26:08.782136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 58/101] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:08.787758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:08.788387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:08.795185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:08.795646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.796430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:08.796855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:08.891005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:08.899142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-36b49d81-3af6-454c-8e89-773ca20fd20b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.523580 Nov 19 19:26:08.899738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 44/102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:09.145921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:09.149900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:09.156413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.157126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.158112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.158557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.162342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:09.176712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-803f8d75-d45d-4f3a-bc81-8012ddd39659 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.393346 Nov 19 19:26:09.184591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 59/103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:08 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:09.626816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:09.638625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-55b6011e-f7d2-449a-ae4b-07cc3b4bc7cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.499450 Nov 19 19:26:09.650368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 45/104] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:09 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:09.702732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-db857dfa-ae68-4338-bab3-4526f5987c93 req-4bf73588-ee6f-41ce-841f-e79035301d46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95be893-491f-4bf9-aa24-491855918b26", "tag": "0eeb739f-3a4a-49e6-9ded-a5fbec042e1f"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:09.704424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:09.704424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:26:09.718979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-db857dfa-ae68-4338-bab3-4526f5987c93 req-4bf73588-ee6f-41ce-841f-e79035301d46 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.719418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-db857dfa-ae68-4338-bab3-4526f5987c93 req-4bf73588-ee6f-41ce-841f-e79035301d46 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.734534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-db857dfa-ae68-4338-bab3-4526f5987c93 req-4bf73588-ee6f-41ce-841f-e79035301d46 service nova] Creating event network-changed:0eeb739f-3a4a-49e6-9ded-a5fbec042e1f for instance c95be893-491f-4bf9-aa24-491855918b26 on hv-cinder-77703 Nov 19 19:26:09.741189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-db857dfa-ae68-4338-bab3-4526f5987c93 req-4bf73588-ee6f-41ce-841f-e79035301d46 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042028 Nov 19 19:26:09.742345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 60/105] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:26:09.800803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:09.803384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:09.813275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.813626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.814793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.815527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.916627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:09.917327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:09.924560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.925219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.926213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:09.926646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:09.978599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:09.987601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:09.990307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:09.991724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-32a89e35-22e1-4564-b006-f090edef6a7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.194657 Nov 19 19:26:09.992570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 46/106] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:26:10.097107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:10.105561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8106ffb4-ba87-47ec-b4f0-ca85d16f446c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.192864 Nov 19 19:26:10.106175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 61/107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:10.195338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:10.195947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:10.202654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:10.203035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:10.203809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:10.204238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:10.340548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:10.348797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d91f1ae2-2112-40a4-9d03-8d0237c7f187 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.157278 Nov 19 19:26:10.350039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 47/108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:10 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:10.656804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:10.657419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:10.664480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:10.664921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:10.666294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:10.667057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:10.803136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:10.810682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-63b8e41c-74b3-4488-a9a9-93971040a6de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.157593 Nov 19 19:26:10.811226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 62/109] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:10 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:11.010898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:11.011516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:11.017816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.018303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.019489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.019931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.122808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:11.123670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:11.132484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.133254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.136092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.138601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.168746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:11.176659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:11.178313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:11.180376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e0ed3a0c-7843-445c-81f6-1108726cf193 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.173244 Nov 19 19:26:11.181083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 48/110] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:11.280754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:11.288911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f10f206b-438e-459a-b8c2-3d3ee5375328 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.169789 Nov 19 19:26:11.289467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 63/111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:11.366199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:11.366845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:11.373325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.373773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.374581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.375014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.730073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:11.737852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ba842d6-e6f2-4be3-9ae5-961fb7bb8c7e tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.375456 Nov 19 19:26:11.738474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 49/112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:11 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:11.793145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-fc55ea88-3a40-45ea-97b1-a10e29b93389 req-0daa25f1-51a5-4248-ab44-57b9f8e5c136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ef8da0-cc9a-484a-b675-ce4bbc67b34d", "tag": "a3960fce-279b-4070-adf3-d00c4dc6f1b3"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:11.795906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:11.795906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:26:11.801714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-fc55ea88-3a40-45ea-97b1-a10e29b93389 req-0daa25f1-51a5-4248-ab44-57b9f8e5c136 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.802316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-fc55ea88-3a40-45ea-97b1-a10e29b93389 req-0daa25f1-51a5-4248-ab44-57b9f8e5c136 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.813686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-fc55ea88-3a40-45ea-97b1-a10e29b93389 req-0daa25f1-51a5-4248-ab44-57b9f8e5c136 service nova] Creating event network-changed:a3960fce-279b-4070-adf3-d00c4dc6f1b3 for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d on hv-cinder-77703 Nov 19 19:26:11.819170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-fc55ea88-3a40-45ea-97b1-a10e29b93389 req-0daa25f1-51a5-4248-ab44-57b9f8e5c136 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029643 Nov 19 19:26:11.819778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 64/113] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:26:11.827812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:11.828431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:11.836485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.836922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:11.837865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:11.838336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:12.200473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:12.202023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:12.211459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:12.212185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:12.213418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:12.214000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:12.244045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:12.258264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1aef85f-3f99-45ec-a9a6-49dad6d844ad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.434984 Nov 19 19:26:12.259170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 50/114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:11 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:12.306002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:12.306653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:12.312602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:12.313053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:12.313823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:12.314283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:12.389496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:12.397460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:12.398949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:12.400145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cc4e5d74-714f-44cb-9dae-ca484507cc0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.204134 Nov 19 19:26:12.400744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 65/115] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:12.464700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:12.473675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ec34b37b-ac70-496b-a41b-f1cf3827929e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.171304 Nov 19 19:26:12.474338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 51/116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:12 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:12.758254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:12.758254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:12.763881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:12.764301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:12.764982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:12.765408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.087813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:13.095592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa795f05-28b2-4420-9303-4556c41b6c98 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.344183 Nov 19 19:26:13.096167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 66/117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:12 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:13.276115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:13.276899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:13.283483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:13.283933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.284724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:13.285161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.418784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:13.419389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:13.426157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:13.426333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:13.426898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.428328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:13.428833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.434869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4565b37b-2ce3-4e72-985d-ad4e378ed42c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.162365 Nov 19 19:26:13.435471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 52/118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:13 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:13.495210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:13.495936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:13.502360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:13.502997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.504002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:13.504439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:13.608490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:13.618536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:13.620137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:13.621319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-387b51e1-88a1-42c2-9d46-94c8b0c28075 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.206343 Nov 19 19:26:13.621945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 67/119] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:13.694779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:13.702375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59235d16-7efb-4fa0-becc-8f66cd996575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.212256 Nov 19 19:26:13.702970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 53/120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:14.112722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:14.113290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:14.120375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.120771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.121552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.121987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.266329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:14.274602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-34f5d305-7112-4b66-ba93-c801fead0b99 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.165350 Nov 19 19:26:14.275581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 68/121] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:14 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:14.452722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:14.453348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:14.460088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.460463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.461259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.461681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.612089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:14.619939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cb0ddd5a-46b7-4da5-bfb3-6d4eebc3eaae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.171045 Nov 19 19:26:14.620509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 54/122] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:14 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:14.642636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:14.643549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:14.651433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.651844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.652727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.653036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.719268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:14.719775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:14.726208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.726638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.727412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:14.727838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:14.827691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:14.836775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:14.838477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:14.839760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-afdf0be9-2ed1-4767-9363-a4206188d426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.203071 Nov 19 19:26:14.840256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 69/123] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:14.894965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:14.902931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4538f387-63f9-445c-b868-f0c96f85a4fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.187407 Nov 19 19:26:14.903505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 55/124] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:15.293437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:15.294127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:15.300832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:15.301267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:15.302067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:15.304096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:15.637984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:15.639351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:15.646258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:15.647026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:15.648638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:15.649238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:15.790002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:15.800699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01ca449a-e079-425b-ae22-76e74e5ac951 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.510967 Nov 19 19:26:15.802859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 70/125] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:15 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:15.861295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:15.863121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:15.869902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:15.871195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:15.872304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:15.872903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:16.022526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:16.031538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89f807f4-3bad-490a-9170-89bafd2fef57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.397496 Nov 19 19:26:16.048583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 56/126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:15 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:16.055875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:16.056679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:16.069876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:16.071225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:16.072327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:16.073319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:16.552572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:16.572786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:16.577802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:16.579923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-359e9f6d-dbfe-4400-b1ae-7cbf3bec58cc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.724284 Nov 19 19:26:16.581443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 71/127] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:16.685320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:16.695628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d29e233b-3f40-424c-af42-731c65271902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.645614 Nov 19 19:26:16.696233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 57/128] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:16.821338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:16.821995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:16.829584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:16.830281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:16.831728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:16.832277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.051916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:17.052802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:17.060397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.060843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.061628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.062181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.069827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:17.083405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d24bfab4-62d0-407e-8164-519ca92e67aa tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.266200 Nov 19 19:26:17.084267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 72/129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:16 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:17.220602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:17.231662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f6c4103f-a03b-4aae-8371-1fad1b85d8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.184850 Nov 19 19:26:17.232579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 58/130] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:17 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:17.602795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:17.604010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:17.614533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.614998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.618272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.618811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.717840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-392415e8-39fc-480e-bd7e-a3474ef1306f req-b84d700d-0ca8-4ba7-abb9-8f48073db1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d879d4cd-e7fb-4405-a218-e89955a7405c", "name": "network-vif-plugged", "status": "completed", "tag": "512afcb1-3817-4353-9942-5484dcaeeb5f"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:17.720242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:17.720242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:26:17.728025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-392415e8-39fc-480e-bd7e-a3474ef1306f req-b84d700d-0ca8-4ba7-abb9-8f48073db1a5 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.729088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-392415e8-39fc-480e-bd7e-a3474ef1306f req-b84d700d-0ca8-4ba7-abb9-8f48073db1a5 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.742829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-392415e8-39fc-480e-bd7e-a3474ef1306f req-b84d700d-0ca8-4ba7-abb9-8f48073db1a5 service nova] Creating event network-vif-plugged:512afcb1-3817-4353-9942-5484dcaeeb5f for instance d879d4cd-e7fb-4405-a218-e89955a7405c on hv-cinder-77703 Nov 19 19:26:17.749123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-392415e8-39fc-480e-bd7e-a3474ef1306f req-b84d700d-0ca8-4ba7-abb9-8f48073db1a5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134853 Nov 19 19:26:17.749889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 59/131] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:17.763362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:17.764566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:17.782794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.785590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.787614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:17.788898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:17.927440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:17.935820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:17.937594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:17.938954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-251ea89d-e878-4898-b1f6-de23884c76d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.343161 Nov 19 19:26:17.940036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 73/132] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:18.103387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:18.103945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:18.110573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:18.111017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:18.111804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:18.112407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:18.210910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:18.220057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-33a35049-d622-4b51-a69c-8c6703832a97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.468902 Nov 19 19:26:18.220854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 60/133] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:17 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:18.262606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:18.265657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:18.278290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:18.278803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:18.279662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:18.280171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:18.415439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:18.430759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2f703b24-f804-45b8-a92e-60405df427d8 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.331276 Nov 19 19:26:18.431449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 74/134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:18 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:18.556977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:18.564316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6be7e92a-ff35-4f6a-be6e-7bea043006da tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.311270 Nov 19 19:26:18.564888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 61/135] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:18 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:18.966813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:18.967551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:18.974106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:18.974633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:18.975993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:18.976630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.139938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:19.149576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:19.151866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:19.153653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d194550-ffdb-4ad9-a268-ef683394d1e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.190196 Nov 19 19:26:19.166816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 75/136] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:19.237943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:19.239309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:19.250600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.253807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.254597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.255028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.457879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:19.471398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:19.488452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.489992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.491216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.492285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.525776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:19.535133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-68597829-9513-4638-96fa-83eb31b5acab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.301729 Nov 19 19:26:19.535999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 62/137] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:19.581892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:19.582632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:19.592235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.592701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.597678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.598241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.765087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:19.780261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-378e62ed-c4ab-4366-8193-29190b735c22 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.325899 Nov 19 19:26:19.781888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 76/138] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:19 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:19.788124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-eda752ed-e8f0-4453-80cd-b95163febf75 req-04131403-9614-4756-816c-71b656df506b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a7238b-b950-4888-8520-304208919484", "name": "network-vif-plugged", "status": "completed", "tag": "45987cad-60cd-4af0-b3cb-efd5455d5a34"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:19.790368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:19.790368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:26:19.802373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-eda752ed-e8f0-4453-80cd-b95163febf75 req-04131403-9614-4756-816c-71b656df506b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:19.802810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-eda752ed-e8f0-4453-80cd-b95163febf75 req-04131403-9614-4756-816c-71b656df506b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:19.825775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-eda752ed-e8f0-4453-80cd-b95163febf75 req-04131403-9614-4756-816c-71b656df506b service nova] Creating event network-vif-plugged:45987cad-60cd-4af0-b3cb-efd5455d5a34 for instance 23a7238b-b950-4888-8520-304208919484 on hv-cinder-77703 Nov 19 19:26:19.831454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-eda752ed-e8f0-4453-80cd-b95163febf75 req-04131403-9614-4756-816c-71b656df506b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047981 Nov 19 19:26:19.832405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 77/139] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:19.835456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:19.843607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71e7b1d6-4310-40a1-af21-06483dba3871 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.265523 Nov 19 19:26:19.844278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 63/140] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:19 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:20.173157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:20.174222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:20.182885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.183533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.184994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.185286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.335280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:20.343749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:20.345180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:20.346327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4068747-5f2a-42e1-a397-ec7b98be225a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.177199 Nov 19 19:26:20.347243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 78/141] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:20.554797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:20.555434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:20.567697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.568591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.570012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.570705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.717582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:20.730553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-759aef57-27af-4fff-9769-7a8026744ddf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.179628 Nov 19 19:26:20.738875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 64/142] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:20.812180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:20.812787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:20.823965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.824462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.825275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.825758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.861770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:20.862420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:20.874322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.874505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:20.875290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:20.875725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:21.075159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:21.088086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b7c4b509-5cca-4def-a5e0-c0a3aa94c008 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.276845 Nov 19 19:26:21.088741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 79/143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:20 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:21.137370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:21.151138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dc0bb9ac-967a-409f-b8b0-3a587597b57e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1321 microversion: 2.1 time: 0.292168 Nov 19 19:26:21.157184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 65/144] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:20 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1321 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:21.366278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:21.366910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:21.373736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:21.374276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:21.375054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:21.375477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:21.522823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:21.530702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:21.532186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:21.533288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-30adfcce-f17b-4d85-8861-e8fdb6950fd1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.171868 Nov 19 19:26:21.533940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 80/145] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:21.749738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:21.750703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:21.758925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:21.759370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:21.760135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:21.760561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:21.910565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:21.918787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-09bf7d46-31f2-47e6-8218-b7465f3f2af1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.174524 Nov 19 19:26:21.919416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 66/146] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:22.105364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:22.105999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:22.112131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.112579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.113347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.113824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.168447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:22.169136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:22.178507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.178952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.179742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.180162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.321544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:22.330129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2f61c3d8-1857-4ac4-a6f1-268e10f435a0 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1315 microversion: 2.1 time: 0.228699 Nov 19 19:26:22.330715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 81/147] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:22 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:22.392347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:22.400380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6c58fe4-67f7-4464-82bc-b21c8033ff6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1515 microversion: 2.1 time: 0.236195 Nov 19 19:26:22.400961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 67/148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:22 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:22.417573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:22.418546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:22.424930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.425443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.426269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.426684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.493821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lazy-loading 'flavor' on Instance uuid d879d4cd-e7fb-4405-a218-e89955a7405c {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:26:22.554560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:22.555818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:22.564236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.565306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.566621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.567467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.669194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2fbd1f58-3a54-4109-bbc1-68346b42d3d2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c/action" status: 200 len: 32 microversion: 2.1 time: 0.254934 Nov 19 19:26:22.669870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 82/149] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:22 2021] POST /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c/action => generated 32 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:22.681213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:22.682077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:22.688688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.689506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.690501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.691072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.758246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:22.769719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:22.771863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:22.773350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de6d4c80-d45a-4279-a342-6e03cffbf8b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.224082 Nov 19 19:26:22.774616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 68/150] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:26:22.870342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:22.878897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ce5c6d6a-0c1c-49d8-bdf7-6e72fa52957b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.203026 Nov 19 19:26:22.879744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 83/151] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:22 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:22.937950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:22.939605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:22.949445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.949917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:22.951017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:22.951661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:23.101997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:23.112435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-af49131d-1f0f-401b-88d9-c384c40a1a5f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.179145 Nov 19 19:26:23.113104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 69/152] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:23.348939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:23.349419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:23.359502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:23.359502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:23.360175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:23.360482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:23.554180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:23.561904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c461b428-2453-4a0d-8ee3-ab77b4a265bd tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1501 microversion: 2.1 time: 0.217242 Nov 19 19:26:23.562798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 84/153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:23 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1501 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:23.794682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:23.795430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:23.802395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:23.803293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:23.804770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:23.805444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:23.905341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:23.906146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:23.913252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:23.913663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:23.914710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:23.915170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:24.097297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:24.117062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:24.118786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:24.120340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-876b3b86-f5ed-428c-95c7-7d85ff3f2baa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.330282 Nov 19 19:26:24.121079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 70/154] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:24.131302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:24.132921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:24.143917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:24.144364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:24.145132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:24.145239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:24.145721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:24.159002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-832d9320-eb82-4362-9fe9-c08d55fb837a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.257675 Nov 19 19:26:24.159584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 85/155] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:23 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:24.329103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:24.337212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81ab43be-84bc-422a-a1b3-cbc6f387ea66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.210678 Nov 19 19:26:24.337795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 71/156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:25.139112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:25.139773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:25.145629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:25.146099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:25.147251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:25.147990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:25.176165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:25.176955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:25.188954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:25.189332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:25.190205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:25.190673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:25.385156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:25.394805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:25.396954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:25.398469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04561483-16b8-4ed9-9243-537f1e539514 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.262902 Nov 19 19:26:25.399552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 86/157] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:26:25.414700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:25.415444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:25.415726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:25.421853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:25.422332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:25.423111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:25.423822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:25.424924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-adc87e0e-c64f-4e8c-a46d-fdf5858c2c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.252697 Nov 19 19:26:25.425690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 72/158] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:25 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:25.569560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:25.577411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0068046-a4d1-4f2c-83cd-47f2822a0160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.176571 Nov 19 19:26:25.578343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 87/159] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:26.247180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-13ea53a5-3c3c-4b14-9b9b-f401e31b20df req-2d1f434b-5cf1-40f0-a380-a568277879ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ef8da0-cc9a-484a-b675-ce4bbc67b34d", "name": "network-vif-plugged", "status": "completed", "tag": "a3960fce-279b-4070-adf3-d00c4dc6f1b3"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:26.247180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:26.247180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:26:26.254671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-13ea53a5-3c3c-4b14-9b9b-f401e31b20df req-2d1f434b-5cf1-40f0-a380-a568277879ec service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:26.255402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-13ea53a5-3c3c-4b14-9b9b-f401e31b20df req-2d1f434b-5cf1-40f0-a380-a568277879ec service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:26.270665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-13ea53a5-3c3c-4b14-9b9b-f401e31b20df req-2d1f434b-5cf1-40f0-a380-a568277879ec service nova] Creating event network-vif-plugged:a3960fce-279b-4070-adf3-d00c4dc6f1b3 for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d on hv-cinder-77703 Nov 19 19:26:26.278224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-13ea53a5-3c3c-4b14-9b9b-f401e31b20df req-2d1f434b-5cf1-40f0-a380-a568277879ec service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038516 Nov 19 19:26:26.279539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 73/160] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:26.417362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:26.418257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:26.424921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:26.425365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:26.426211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:26.426621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:26.442766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:26.443526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:26.454645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:26.455046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:26.455879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:26.456303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:27.047458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:27.056285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:27.057378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:27.063833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-725f3dcb-0277-424e-94f4-9e957cd48cfa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.624910 Nov 19 19:26:27.064558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:27.065997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a5c7602-213a-43c5-8862-841d4fc8fa84 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.653082 Nov 19 19:26:27.067219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 74/161] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:26 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:27.067829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 88/162] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:26:27.072232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:27.075170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:27.084538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:27.085032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:27.085900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:27.086541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:27.129992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76711685-1659-4925-b47c-cba3105e8cfe"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:27.132475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:27.139997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:27.140655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:27.141574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:27.142192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:27.265868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:27.276926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8cb990bd-b960-4a6d-ae6b-19ebd031e27a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.205979 Nov 19 19:26:27.276926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 75/163] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:27.575342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a55d652-90ba-4eeb-935e-e828d3be7a08 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "POST /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.448869 Nov 19 19:26:27.576545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 89/164] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:26:27 2021] POST /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:28.082352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:28.083260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:28.087873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:28.088652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:28.091179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.091848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.092819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.093434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.102612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.104244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.106512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.107123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.383246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:28.401426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:28.403439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:28.405528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b715233d-190a-4d96-89b0-b60eed6ef15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1405 microversion: 2.20 time: 0.323911 Nov 19 19:26:28.406502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 90/165] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1405 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:28.411839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:28.412783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:28.419288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.420920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.426824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.428083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.441345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:28.449864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc151b97-a9eb-4313-bdbb-4f0fa89f88d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.372903 Nov 19 19:26:28.453999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 76/166] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:28 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:28.464254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-bc819271-7337-4902-8e13-7103c2ed7d35 req-5ec0da26-050b-4942-9b19-1e6f3e19b642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95be893-491f-4bf9-aa24-491855918b26", "name": "network-vif-plugged", "status": "completed", "tag": "0eeb739f-3a4a-49e6-9ded-a5fbec042e1f"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:28.468633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:28.468633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:26:28.485349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-bc819271-7337-4902-8e13-7103c2ed7d35 req-5ec0da26-050b-4942-9b19-1e6f3e19b642 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:28.489818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-bc819271-7337-4902-8e13-7103c2ed7d35 req-5ec0da26-050b-4942-9b19-1e6f3e19b642 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:28.522485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-bc819271-7337-4902-8e13-7103c2ed7d35 req-5ec0da26-050b-4942-9b19-1e6f3e19b642 service nova] Creating event network-vif-plugged:0eeb739f-3a4a-49e6-9ded-a5fbec042e1f for instance c95be893-491f-4bf9-aa24-491855918b26 on hv-cinder-77703 Nov 19 19:26:28.528802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-bc819271-7337-4902-8e13-7103c2ed7d35 req-5ec0da26-050b-4942-9b19-1e6f3e19b642 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069251 Nov 19 19:26:28.529736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 77/167] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:28.705824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:28.729091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6465a4a8-4415-4dbe-af49-61b961e866d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.319086 Nov 19 19:26:28.731011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 91/168] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:29.424694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:29.425479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:29.432130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.432666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.433595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.434419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.469783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:29.470395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:29.477347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.478090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.478878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.479278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.622818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:29.635313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:29.636934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:29.638368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f07fbb6b-2456-4833-b02e-44397ae6b112 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1598 microversion: 2.20 time: 0.218008 Nov 19 19:26:29.643381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 78/169] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:26:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1598 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:29.661370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:29.661868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:29.669010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.670385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.672351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.673956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.796746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:29.829039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-581cb79f-f0e5-4bf6-bbcf-5ce87ca2295e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.361053 Nov 19 19:26:29.829886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 92/170] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:29 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:29.845338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:29.846899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:29.857389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.858026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.859938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:29.860529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:29.952733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-216cbadc-1b5d-4495-bffb-56fbf7fa329e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.294896 Nov 19 19:26:29.953463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 79/171] 10.222.0.46 () {60 vars in 1315 bytes} [Fri Nov 19 19:26:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-interface => generated 285 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:26:30.208240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:30.217391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01081fa9-aaa5-4ca7-bacc-d1c62f4fab68 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1363 microversion: 2.1 time: 0.385170 Nov 19 19:26:30.234473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 93/172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1363 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:30.552773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-9750df3d-0500-49f8-ae8e-e16fe2603ee6 req-86235851-b9ff-40ef-8dd5-6f873bf2153a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38904995-d04e-4db1-93b4-52153ee2c2e2", "name": "network-vif-plugged", "status": "completed", "tag": "610b92c9-51b5-4f46-ae92-d11988ba413e"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:30.556462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:30.556462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:26:30.574740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-9750df3d-0500-49f8-ae8e-e16fe2603ee6 req-86235851-b9ff-40ef-8dd5-6f873bf2153a service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:30.575698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-9750df3d-0500-49f8-ae8e-e16fe2603ee6 req-86235851-b9ff-40ef-8dd5-6f873bf2153a service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:30.611505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-9750df3d-0500-49f8-ae8e-e16fe2603ee6 req-86235851-b9ff-40ef-8dd5-6f873bf2153a service nova] Creating event network-vif-plugged:610b92c9-51b5-4f46-ae92-d11988ba413e for instance 38904995-d04e-4db1-93b4-52153ee2c2e2 on hv-cinder-77703 Nov 19 19:26:30.627779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-9750df3d-0500-49f8-ae8e-e16fe2603ee6 req-86235851-b9ff-40ef-8dd5-6f873bf2153a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080826 Nov 19 19:26:30.652488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 80/173] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:30.849250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:30.850037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:30.857582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:30.858075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:30.858877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:30.859299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:31.113964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:31.128960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4f4a4ac8-d1c5-487a-a973-ccbd0a8a7074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.286592 Nov 19 19:26:31.139541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 94/174] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:30 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:31.239914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:31.240922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:31.265294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:31.265971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:31.267149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:31.267798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:31.513658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:31.526088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-122fb1ec-5be3-4ed9-9648-56927a6ae23c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1548 microversion: 2.1 time: 0.289227 Nov 19 19:26:31.529342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 81/175] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1548 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:31.546695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:31.547192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:31.555405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:31.559464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:31.560377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:31.560887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:31.688472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27872b8a-9d8b-4be1-b974-7c89f6e06f41 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146532 Nov 19 19:26:31.689113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 95/176] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Nov 19 19:26:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:32.004102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:32.005406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:32.012093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-3bbb8f8a-d496-4436-92c9-56464ba69d76 req-4451ff2a-4161-4424-bac9-6a48e8289156 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35ef8da0-cc9a-484a-b675-ce4bbc67b34d", "tag": "a3960fce-279b-4070-adf3-d00c4dc6f1b3"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:32.013793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:32.013793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:26:32.016603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:32.017739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:32.017841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:32.022361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:32.024617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3bbb8f8a-d496-4436-92c9-56464ba69d76 req-4451ff2a-4161-4424-bac9-6a48e8289156 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:32.025062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3bbb8f8a-d496-4436-92c9-56464ba69d76 req-4451ff2a-4161-4424-bac9-6a48e8289156 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:32.038010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-3bbb8f8a-d496-4436-92c9-56464ba69d76 req-4451ff2a-4161-4424-bac9-6a48e8289156 service nova] Creating event network-changed:a3960fce-279b-4070-adf3-d00c4dc6f1b3 for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d on hv-cinder-77703 Nov 19 19:26:32.043884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-3bbb8f8a-d496-4436-92c9-56464ba69d76 req-4451ff2a-4161-4424-bac9-6a48e8289156 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036880 Nov 19 19:26:32.045780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 96/177] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:32.148338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:32.149296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:32.158848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:32.159496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:32.160780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:32.161366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:32.174791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20ae642d-b6f1-4254-9e69-6b439a6359ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.175395 Nov 19 19:26:32.177303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 82/178] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:31 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:33.193509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:33.194941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:33.218615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:33.220317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:33.223118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:33.223562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:33.247141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:33.259869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6ffff98-ab18-4080-9b00-2714d7e6e799 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 1.116700 Nov 19 19:26:33.265917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 97/179] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:32 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:33.396780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e1a14ebb-ce6a-4db4-a1ca-d1fe92e358b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.208278 Nov 19 19:26:33.397527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 83/180] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:33 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:34.140245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:34.141320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:34.146727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-f94d6ab1-d486-4665-ad40-e0420b0042f9 req-80d22e0a-2405-4e41-903b-c324e5959ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c95be893-491f-4bf9-aa24-491855918b26", "tag": "0eeb739f-3a4a-49e6-9ded-a5fbec042e1f"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:34.148663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:34.148663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:26:34.150708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.154640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.157220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.157853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.165974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-f94d6ab1-d486-4665-ad40-e0420b0042f9 req-80d22e0a-2405-4e41-903b-c324e5959ddb service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.167897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-f94d6ab1-d486-4665-ad40-e0420b0042f9 req-80d22e0a-2405-4e41-903b-c324e5959ddb service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.192537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-f94d6ab1-d486-4665-ad40-e0420b0042f9 req-80d22e0a-2405-4e41-903b-c324e5959ddb service nova] Creating event network-changed:0eeb739f-3a4a-49e6-9ded-a5fbec042e1f for instance c95be893-491f-4bf9-aa24-491855918b26 on hv-cinder-77703 Nov 19 19:26:34.227417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-f94d6ab1-d486-4665-ad40-e0420b0042f9 req-80d22e0a-2405-4e41-903b-c324e5959ddb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085422 Nov 19 19:26:34.231436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 84/181] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:26:34.280940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:34.283308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:34.289410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dd6c2a0c-8945-460a-98b6-35e86c0c86cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.152693 Nov 19 19:26:34.292843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 98/182] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:34 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:34.293005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.293498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.294682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.295971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.408492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:34.409434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:34.444473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.444939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.448725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:34.451140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:34.556268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:34.569687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-92ac82e0-2e56-43db-b8f7-84ee16d460ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.292303 Nov 19 19:26:34.570160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 85/183] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:34 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:34.627279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6eaa2cb7-34a8-4366-921c-c290e9d159a6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.222515 Nov 19 19:26:34.629197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 99/184] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:34 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:35.305107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:35.306898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:35.316694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:35.317404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:35.320368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:35.321311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:35.440762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e89877a4-035e-470e-8cc9-9dbf1ee30d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.140420 Nov 19 19:26:35.441807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 86/185] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:35 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:35.586817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:35.587500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:35.594913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:35.595699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:35.597056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:35.597693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:35.641258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:35.642446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:35.652199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:35.652751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:35.653608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:35.654423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:35.782033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:35.791498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9fc76bfd-6cca-42e7-9434-94cc67a30409 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.209069 Nov 19 19:26:35.801574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 100/186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:35 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:35.857903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ebddedc8-5902-4506-b910-3e4c81d3c9e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.220916 Nov 19 19:26:35.859081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 87/187] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:35 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:36.453059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:36.453991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:36.461393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:36.461840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:36.462655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:36.463088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:36.556535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8de68549-2e16-4a6b-b04a-d56e065c363a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.107907 Nov 19 19:26:36.557648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 101/188] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:36 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:36.809746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:36.810428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:36.817912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:36.818500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:36.819288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:36.819740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:36.870011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:36.871180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:36.879457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:36.880047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:36.881021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:36.881993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:37.103354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:37.128394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-28315107-bff4-4922-bcf1-ac43e855bfaa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.322672 Nov 19 19:26:37.140935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 88/189] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:36 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:37.570803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:37.570803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:37.588370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:37.589577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:37.591909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:37.592398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:40.899514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ab9381f6-72f2-4c1e-849a-d63b765365cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 4.034062 Nov 19 19:26:40.902811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 102/190] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:36 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 4036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:40.905666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:40.906417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:40.917209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:40.917209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:40.917209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:40.917209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:41.019006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1061dc95-e692-4ddc-aba9-f0a344716fa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 3.454083 Nov 19 19:26:41.020626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 89/191] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:37 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 3457 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:41.136457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:41.144793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7f8f8547-e4c0-49ea-a833-e15cec09ac90 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.243010 Nov 19 19:26:41.145572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 103/192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:40 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:41.911124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:41.912482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:41.919272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:41.919721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:41.920499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:41.921106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.020286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40eed229-e2e3-494e-8985-f9df1a2d7725 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.112960 Nov 19 19:26:42.021528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 90/193] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:41 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:42.031087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:42.032062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:42.039158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:42.039608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.040430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:42.040851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.136072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d50b804e-37f9-4011-8981-de35b4953013 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.108536 Nov 19 19:26:42.137148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 104/194] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:42 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:42.162970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:42.163670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:42.170840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:42.171284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.172056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:42.172486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.313212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:42.320797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7cea1f15-dc0a-47a5-af70-de5febc49c05 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.162271 Nov 19 19:26:42.321357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 91/195] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:42 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:42.874540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:42.875117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:42.882252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:42.882704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.883478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:42.884209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:42.908481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:26:43.006082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ca0df612-9a31-434a-8124-68f61d3f0de9 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 204 len: 0 microversion: 2.1 time: 0.134549 Nov 19 19:26:43.007016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 105/196] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:26:42 2021] DELETE /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:26:43.018829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:43.020484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:43.034253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:43.036176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:43.049530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.050482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.051823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.052275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.055405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.055848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.058161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.059050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.177087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c5b2aec-4d66-492b-88e8-2344e60dafc0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.148749 Nov 19 19:26:43.178094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 106/197] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:43 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:43.184833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:43.187586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:43.200237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.200731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.201610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.202073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.235219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:43.246467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d3f2287-6578-411f-b0cf-ee7bdc2add63 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1553 microversion: 2.1 time: 0.234242 Nov 19 19:26:43.247055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 92/198] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:43 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1553 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:43.337268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ef1d565-4284-463c-aafb-9dbd27c49f03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.157831 Nov 19 19:26:43.338237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 107/199] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:43 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:43.338703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:43.339306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:43.346135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.346932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.347878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:43.348305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:43.493859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:43.509166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a28334e-1892-4156-b230-f6973016fecb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.174019 Nov 19 19:26:43.509777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 93/200] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:43 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:44.189637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:44.190677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:44.205996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.206604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.207753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.208185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.267261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:44.268063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:44.281242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.281621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.282466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.282904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.298713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e5592afa-9728-46da-b0a8-6af45819b89b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.113096 Nov 19 19:26:44.299709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 108/201] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:44 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:44.351664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:44.352700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:44.360638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.361250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.362237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.362832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.464484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c49c8e14-b034-4032-9d54-bfcb1711e3ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.118013 Nov 19 19:26:44.465450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 109/202] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:44 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 19:26:44.489883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:44.500490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5eec438-cb31-4d88-bec9-ef82111382d4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1553 microversion: 2.1 time: 0.236880 Nov 19 19:26:44.501292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 94/203] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:44 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:44.529820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:44.530598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:44.538229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.538679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.539766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:44.540208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:44.772866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:44.781877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d6de5314-c569-4c96-aca8-be2b2b1bb9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.258122 Nov 19 19:26:44.782641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 110/204] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:44 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:45.310406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:45.311233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:45.317654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.318496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.319549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.320404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.423377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-10eaed84-396b-4934-8f32-ee83aab73736 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.116739 Nov 19 19:26:45.424505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 95/205] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:45 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:45.477397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:45.479152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:45.492780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.493266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.494272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.494616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.519136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:45.519839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:45.531690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.532175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.532980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.533413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.597572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52ba9e0e-ffca-455f-b152-9fa6f13ced10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.124051 Nov 19 19:26:45.600481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 111/206] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:45 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:45.735784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:45.747302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5611c0d-4319-4f01-950f-e659a38cee62 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1553 microversion: 2.1 time: 0.232492 Nov 19 19:26:45.748118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 96/207] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:45 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:45.801156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:45.801891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:45.812385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.812842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.813632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:45.814150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:45.975729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:45.985231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bac8ae3f-093d-4a2a-8f60-dd2c47097657 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.188342 Nov 19 19:26:45.985993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 112/208] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:45 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:46.443740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:46.448275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:46.464899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:46.465371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:46.467951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:46.468629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:46.594345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a00f6bd9-f5bc-41f7-b18c-745f3cf98647 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.162795 Nov 19 19:26:46.594981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 97/209] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:46 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:46.609940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:46.612036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:46.619799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:46.620507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:46.621706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:46.622336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:46.720885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-60d961ff-2241-4def-b98f-66c79f558686 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.115628 Nov 19 19:26:46.721924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 113/210] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:46 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:46.765669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:46.766624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:46.775002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:46.775470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:46.776731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:46.777177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.009781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:47.020537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:47.036248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.037057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.038238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.038777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.061646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:47.076071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-78294029-c74c-4d2e-b5c3-c8d210dbec92 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1553 microversion: 2.1 time: 0.312221 Nov 19 19:26:47.077269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 98/211] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:46 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1553 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:47.084116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-dfb1414d-c20d-4f5d-aec5-06bc5c461a43 req-c70c88dc-b0a3-46e8-b098-48c6f682a07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23a7238b-b950-4888-8520-304208919484", "name": "network-vif-deleted", "tag": "45987cad-60cd-4af0-b3cb-efd5455d5a34"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:47.085974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:26:47.085974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:26:47.105289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-dfb1414d-c20d-4f5d-aec5-06bc5c461a43 req-c70c88dc-b0a3-46e8-b098-48c6f682a07b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.106096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-dfb1414d-c20d-4f5d-aec5-06bc5c461a43 req-c70c88dc-b0a3-46e8-b098-48c6f682a07b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.125806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-dfb1414d-c20d-4f5d-aec5-06bc5c461a43 req-c70c88dc-b0a3-46e8-b098-48c6f682a07b service nova] Creating event network-vif-deleted:45987cad-60cd-4af0-b3cb-efd5455d5a34 for instance 23a7238b-b950-4888-8520-304208919484 on hv-cinder-77703 Nov 19 19:26:47.145707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-dfb1414d-c20d-4f5d-aec5-06bc5c461a43 req-c70c88dc-b0a3-46e8-b098-48c6f682a07b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059105 Nov 19 19:26:47.147522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 99/212] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:26:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:26:47.240105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:47.249187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3a1719bf-47a6-4ee1-a156-4cac8f639830 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.247562 Nov 19 19:26:47.250095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 114/213] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:46 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:47.606751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:47.607751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:47.615492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.616162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.617419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.618005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.716494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-35713bd7-753d-4c43-a8fb-01e92be60d4c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.114065 Nov 19 19:26:47.717129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 100/214] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:47 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:47.734027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:47.735663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:47.743459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.745095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.747369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:47.748059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:47.859534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3577b3b3-cbc6-45da-a0bb-e4749f5d0f19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.129665 Nov 19 19:26:47.860324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 115/215] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:47 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 19:26:48.098763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:48.100152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:48.108565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.109197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.110833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.111858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.242475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.246757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.247591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lazy-loading 'fault' on Instance uuid 23a7238b-b950-4888-8520-304208919484 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:26:48.270016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:48.271280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:48.294295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.295805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.297742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.299066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.375094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e4de778d2f54a44a174d8bfe7580289', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34b4455324c0486da550c1ffdb506a1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:48.384705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-adcd13a6-7047-4e6f-b43c-83e64b2ead95 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 200 len: 1351 microversion: 2.1 time: 0.292200 Nov 19 19:26:48.389701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 101/216] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:48 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 1351 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:48.555014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:48.564647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d46a50b-d1f3-4abb-8eed-a066c0489bcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.300459 Nov 19 19:26:48.574944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 116/217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:48 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:48.728766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:48.729936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:48.737134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.737821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.738812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.739255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.832977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-61a87dae-5ae8-414f-b6b1-f978f65123c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.108755 Nov 19 19:26:48.833814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 102/218] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:48 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:48.870929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:48.872096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:48.879517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.879959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.880801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:48.881229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:48.975572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0197a218-6e39-4b4e-8ba4-2b9c28e90ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.108181 Nov 19 19:26:48.978893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 117/219] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:48 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 19:26:49.405722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:49.406771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:49.422564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.423224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.424978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.426294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.447619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] HTTP exception thrown: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. Nov 19 19:26:49.448327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Returning 404 to user: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:26:49.450304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8617f7d9-194a-4068-b2b2-cbe4a6f739d7 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 404 len: 111 microversion: 2.1 time: 0.050518 Nov 19 19:26:49.455566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 103/220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:49 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:26:49.584365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:49.584841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:49.594476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.594937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.595841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.596281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.666657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:49.667819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:49.674385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.675070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.676197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.676992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.701201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] HTTP exception thrown: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. Nov 19 19:26:49.701810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Returning 404 to user: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:26:49.702674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d19fd1bb-8954-4437-92ec-d7e3f5377d85 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040107 Nov 19 19:26:49.706655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 104/221] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:26:49 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 19:26:49.810613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:49.823560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88269330-f367-45f1-9644-8022bce300bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.244236 Nov 19 19:26:49.824919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 118/222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:49 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:49.847989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:49.851680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:49.863929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.864894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.866597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.868095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.986722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:49.987829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:49.994497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.995231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:49.996413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:49.997154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:52.366160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-108e45ff-9b44-4706-9f2e-c8c114d4ba87 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 2.524943 Nov 19 19:26:52.378932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 105/223] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:49 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 2539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:52.411951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:52.413905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:52.432223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:52.432897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:52.454849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:52.455311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:52.593438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:52.601448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6049323d-f0aa-4145-9b0e-4999bc4af6ba tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.221206 Nov 19 19:26:52.602065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 106/224] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:52 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:53.424783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:53.425815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:53.433380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:53.433988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:53.435115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:53.435741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:54.030231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e24571a2-1758-493b-becd-e3fed4c5751e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 4.046622 Nov 19 19:26:54.031271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 119/225] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:49 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 4049 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 19:26:54.040310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:54.041465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:54.042452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ec25e25e-d64b-4353-ad0d-97d1956c0996 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.621061 Nov 19 19:26:54.043210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 107/226] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:53 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:54.053755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:54.054501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:54.055845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:54.056613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:54.229373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:54.237506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-090e6600-68b4-4485-bbc9-b1998cc7841d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.204495 Nov 19 19:26:54.238100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 120/227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:54 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:55.043566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:55.044637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:55.052019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.052737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.053689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.054315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.055269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:55.056786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:55.064942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.065835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.066861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.068278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.151804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bdb2da91-e366-459d-922a-4683dc5c3b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.112496 Nov 19 19:26:55.152659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 108/228] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:55 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:26:55.181843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-971df624-0fb5-4534-b0d7-a4ff7319edfa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.132201 Nov 19 19:26:55.185409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 121/229] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:55 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:26:55.255391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:55.256108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:55.265055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.265504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.266323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.270998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.458146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:55.466227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0be652c7-507c-477a-aa86-b4c7d86bc190 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.215065 Nov 19 19:26:55.479475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 109/230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:55 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:55.536673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:55.537303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:55.545100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.545998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.546837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.547365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.565425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] HTTP exception thrown: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. Nov 19 19:26:55.566021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Returning 404 to user: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:26:55.566870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dbec671c-1fe9-49bc-9b91-bde427114dff tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "DELETE /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 404 len: 111 microversion: 2.1 time: 0.034404 Nov 19 19:26:55.567749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 122/231] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:26:55 2021] DELETE /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:26:55.576925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:55.577753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] [instance: 23a7238b-b950-4888-8520-304208919484] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:55.588989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.589490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.591787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:55.592384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:55.609250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] HTTP exception thrown: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. Nov 19 19:26:55.609755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] Returning 404 to user: Instance 23a7238b-b950-4888-8520-304208919484 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:26:55.610652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d98ac62d-d37b-48c6-b3ce-7ecd0a2485a4 tempest-DeleteServersTestJSON-2107833685 tempest-DeleteServersTestJSON-2107833685-project] 10.222.0.46 "GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484" status: 404 len: 111 microversion: 2.1 time: 0.038138 Nov 19 19:26:55.611204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 110/232] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:55 2021] GET /compute/v2.1/servers/23a7238b-b950-4888-8520-304208919484 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:26:56.163560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:56.164413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:56.171426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:56.171859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:56.172681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:56.173119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:56.193389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:56.194483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:56.201137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:56.201584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:56.202615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:56.203796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:56.272061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11b245f0-9642-4f15-90b6-249eaa1b4734 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 14 microversion: 2.1 time: 0.112878 Nov 19 19:26:56.272734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 123/233] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:56 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 19:26:56.292608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbe51a77-21dc-4914-8367-64aeee53bf37 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 14 microversion: 2.20 time: 0.103296 Nov 19 19:26:56.293262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 111/234] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:56 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:56.488443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:56.489465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:56.497672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:56.498496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:56.499567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:56.500137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:56.713205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:56.721038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0aa0efb-5f46-47f8-a8f7-0c00b7b77906 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.238347 Nov 19 19:26:56.722072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 124/235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:56 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:57.283956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:57.284958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:57.292711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:57.293158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:57.293947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:57.294429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:57.304100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:57.305027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:57.311914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:57.312361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:57.313135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:57.313800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:57.401139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0949ce26-38e1-4fae-be75-c995c1abe2ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 6451 microversion: 2.1 time: 0.121273 Nov 19 19:26:57.402208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 112/236] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:57 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 6451 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:57.442438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eb1e6183-5533-4c19-b0c8-d35845de3f14 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 6451 microversion: 2.20 time: 0.142268 Nov 19 19:26:57.443443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 125/237] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:57 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 6451 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:26:57.740415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:57.741292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:57.748725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:57.749276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:57.750154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:57.750655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:57.912931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:57.922445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11ed0363-0252-4868-87fb-692a485b31e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.186722 Nov 19 19:26:57.923513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 113/238] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:57 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:58.460537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:58.462097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:58.465073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:58.466742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:58.482225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:58.482675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:58.483473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:58.483904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:58.507022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:58.507483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:58.511425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:58.511947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:58.698109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b2c6aa31-555e-43fd-8235-acb7703e7faf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 11050 microversion: 2.20 time: 0.243575 Nov 19 19:26:58.699166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 114/239] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:58 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 11050 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:26:58.713268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad939736-82b3-4c61-b7cb-ef1cd4f4ed12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 11454 microversion: 2.1 time: 0.262959 Nov 19 19:26:58.716022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 126/240] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:58 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 11454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:26:58.942413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:26:58.943528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:58.969322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:58.972509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:58.972509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:58.975444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:59.336426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:26:59.345683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-633095da-9031-4a38-81ee-452fe86070fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.407766 Nov 19 19:26:59.356982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 115/241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:26:58 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:26:59.643516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1641336780", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "c78e7b75-b174-443c-b78e-86db23075f67"}]}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:59.713340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:59.714707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:59.716065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] validate_networks() for [('c78e7b75-b174-443c-b78e-86db23075f67', None, None, None, None, None)] {{(pid=116111) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:26:59.736966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:59.737336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:59.738581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:59.739339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:59.890392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c93eff4a-bffa-435a-a646-ee20222cd49e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 15025 microversion: 2.20 time: 0.183304 Nov 19 19:26:59.895028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 116/242] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:26:59 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 15025 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:26:59.905725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:26:59.908848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:26:59.928570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:59.930105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:26:59.937005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:26:59.940260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:00.132211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aaa7b045-a84a-46ff-ad6e-27b4369a1ef7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 15064 microversion: 2.1 time: 0.235195 Nov 19 19:27:00.132880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 117/243] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:26:59 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 15064 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:00.344091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:27:00.344700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:27:00.345171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:27:00.345578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:27:00.345987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:27:00.365412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:00.365861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:00.366773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:00.367627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:00.369157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:00.370298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:00.378912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:00.379439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:00.380589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:00.381184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:00.419849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:00.430448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for user 4df88e053d6049e9bee5470199b7295d and project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:00.454308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Going to run 1 instances... {{(pid=116111) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:27:00.456785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:27:00.511988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c183c7d7-4704-4e0d-93f8-d2082dc41506 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041030 Nov 19 19:27:00.512902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 127/244] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:26:59 2021] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 19:27:00.523362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6f9b1d4-fa92-4928-b054-fa9742ba2e11 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:00.524938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6f9b1d4-fa92-4928-b054-fa9742ba2e11 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:00.630470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6f9b1d4-fa92-4928-b054-fa9742ba2e11 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:00.657402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6f9b1d4-fa92-4928-b054-fa9742ba2e11 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1218 microversion: 2.1 time: 0.134247 Nov 19 19:27:00.658820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 128/245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:00 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:00.720169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:00.730215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd934f39-6825-4c44-ad0d-9ddd7ef40ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.368865 Nov 19 19:27:00.730806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 118/246] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:00 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:00.902610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:00.903588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:00.918729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:00.919182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:00.919989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:00.920421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.048990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-446fc589-56f6-450a-8e31-76b8b0cd7bb3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 17300 microversion: 2.20 time: 0.150123 Nov 19 19:27:01.050146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 129/247] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:00 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 17300 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:01.152878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:01.154762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:01.164150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:01.165305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.166924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:01.167499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.574621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-742b1376-9383-448b-83e3-0b27a0dc5613 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 17602 microversion: 2.1 time: 0.427443 Nov 19 19:27:01.574621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 119/248] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:01 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 17602 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:01.680401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:01.681715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:01.689579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:01.690037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.690859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:01.691286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.749454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:01.750640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:01.760598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:01.760747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:01.761436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.762581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:01.763647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:01.769131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7fa87b48-4d88-4e86-9077-9ff4880db73b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1270 microversion: 2.1 time: 0.095695 Nov 19 19:27:01.769687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 130/249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:01 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:01.933029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:01.947749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e076f02b-f7bc-4005-b4c2-00ed6873decd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1521 microversion: 2.1 time: 0.202673 Nov 19 19:27:01.948449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 120/250] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:01 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:02.060484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:02.061956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:02.069712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.070504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.071580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.072217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.196764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4435d6fb-ad56-4325-9d19-c5923dc43092 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 17659 microversion: 2.20 time: 0.140034 Nov 19 19:27:02.198784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 131/251] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:02 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 17659 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:02.581696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:02.582968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:02.591091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.591741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.592767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.593265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.714318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-079e97b1-c997-4646-a778-872c6e3d8f49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 17602 microversion: 2.1 time: 0.137061 Nov 19 19:27:02.724763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 121/252] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:02 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 17602 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:02.787706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:02.789192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:02.796781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.798351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.799445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.800088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.972972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:02.975069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:02.982358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:02.992953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.995604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:02.996913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:02.997921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.005012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0f95f4bb-0233-474b-8bba-f81c7eba6695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1276 microversion: 2.1 time: 0.220173 Nov 19 19:27:03.007644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 132/253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:02 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:03.214147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:03.216552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:03.226386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:03.226993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.227951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:03.228528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.324545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:03.333191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f93f2543-4a7a-4ca2-a513-7ef0d0af9bd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1501 microversion: 2.1 time: 0.370670 Nov 19 19:27:03.333826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 122/254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:02 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1501 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:03.351854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:03.352839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:03.354252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5934690b-1cb7-47cc-a0a9-d7d1ed10ec83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 17659 microversion: 2.20 time: 0.149113 Nov 19 19:27:03.355217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 133/255] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:03 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 17659 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:03.359870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:03.360514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.361449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:03.362168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.616711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:03.624553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9fc53b87-149b-4a9d-bf21-bcdf977879f9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1515 microversion: 2.1 time: 0.278372 Nov 19 19:27:03.625297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 123/256] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:03.726617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:03.727715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:03.734427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:03.734870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.743744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:03.744569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:03.866153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a785d9f-6be6-42e3-933f-f80490ecad91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 17861 microversion: 2.1 time: 0.144367 Nov 19 19:27:03.867507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 134/257] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:03 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 17861 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:04.024552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:04.025141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:04.032311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.036914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.038302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.038932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.368765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:04.369980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:04.375423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:04.378934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.379384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.380517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.381062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.384757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14a78ab5-0537-47c0-9f6f-0505211f5148 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.364744 Nov 19 19:27:04.385970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 124/258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:04 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:04.510087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0db59eac-ccdb-4e77-8d00-0a960e9c042e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 19342 microversion: 2.20 time: 0.143219 Nov 19 19:27:04.516221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 135/259] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:04 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 19342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:04.519564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-09dad3bd-b962-422a-972e-f18ec0b3ef9e req-5d9c26c0-efbd-4272-ad90-f08f0ba0e3e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb9a8b1e-63df-4ecb-b090-cc77517dac92", "tag": "ea619087-b804-4ac0-bda5-f98356052e0f"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:04.522831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:27:04.522831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:27:04.548568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-09dad3bd-b962-422a-972e-f18ec0b3ef9e req-5d9c26c0-efbd-4272-ad90-f08f0ba0e3e1 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.549166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-09dad3bd-b962-422a-972e-f18ec0b3ef9e req-5d9c26c0-efbd-4272-ad90-f08f0ba0e3e1 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.561904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-09dad3bd-b962-422a-972e-f18ec0b3ef9e req-5d9c26c0-efbd-4272-ad90-f08f0ba0e3e1 service nova] Creating event network-changed:ea619087-b804-4ac0-bda5-f98356052e0f for instance cb9a8b1e-63df-4ecb-b090-cc77517dac92 on hv-cinder-77703 Nov 19 19:27:04.566838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-09dad3bd-b962-422a-972e-f18ec0b3ef9e req-5d9c26c0-efbd-4272-ad90-f08f0ba0e3e1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059015 Nov 19 19:27:04.567863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 125/260] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:27:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:27:04.884113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:04.885982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:04.894535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.895786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.897302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:04.897942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:04.995499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aae41ef9-1327-461f-a62b-fdc1a7d39beb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 19342 microversion: 2.1 time: 0.118198 Nov 19 19:27:04.996189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 136/261] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:04 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 19342 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:05.160393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:05.163396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:05.173086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:05.173967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:05.175277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:05.175977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:05.219762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lazy-loading 'flavor' on Instance uuid 38904995-d04e-4db1-93b4-52153ee2c2e2 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:27:05.406311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:05.407021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:05.420491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:05.420940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:05.424830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:05.425708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:05.499151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e21701f-cb40-4464-add5-519c4a671304 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action" status: 200 len: 32 microversion: 2.1 time: 0.349030 Nov 19 19:27:05.499776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 126/262] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:05 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:27:05.516386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:05.518405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:05.533357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:05.534146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:05.535260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:05.536162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:06.039204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:06.052091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a3b6430a-5e3f-48ce-8479-9c8df53be1f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.652689 Nov 19 19:27:06.052690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 137/263] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:05 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:06.066562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:06.069886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:06.104580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:06.119375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7d040d5-6146-469f-9a94-a05bee1742b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.613221 Nov 19 19:27:06.119585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:06.119987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 127/264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:06.139442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:06.140443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:06.140556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:06.140898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:06.141414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:06.151975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:06.152479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:06.153220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:06.153808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:06.280211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eaf24ae6-1a27-4398-ac97-f8cdd3fe2062 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 21664 microversion: 2.1 time: 0.149297 Nov 19 19:27:06.281027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 128/265] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:06 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 21664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:06.351896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b3f2edf2-265f-4a4b-abf7-d5285e2efa8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 21784 microversion: 2.20 time: 0.297605 Nov 19 19:27:06.352554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 138/266] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:06 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 21784 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:07.070713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:07.072017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:07.086974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.087429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.088237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.088674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.145021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:07.146831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:07.157882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.159383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.160796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.161461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.630333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:07.643177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c0b05590-f668-439c-8c08-a943e99e8099 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.506021 Nov 19 19:27:07.643930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 139/267] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:07.649005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:07.659887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:07.668128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.669431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.670319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.671036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.724236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:07.735581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aaad6693-593d-445e-8c5c-11f78e86e391 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.670076 Nov 19 19:27:07.737298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 129/268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:07 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:07.753047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:07.756261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:07.789083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.789527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.794740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:07.794934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:07.806326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c1979c7-9d6c-4a2d-a757-74b7e445a76f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 23181 microversion: 2.1 time: 0.160881 Nov 19 19:27:07.807727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 140/269] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:07 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 23181 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:07.981111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-362bb958-eed0-4699-b34f-0d186cf6820d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 23225 microversion: 2.20 time: 0.242248 Nov 19 19:27:07.981822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 130/270] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:07 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 23225 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:08.662124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:08.663610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:08.678685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:08.679400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:08.680221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:08.680647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:08.756859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:08.760293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:08.781359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:08.782467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:08.785784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:08.788624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:08.962095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:08.974596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-70e1bd9c-e766-4985-9aed-71c239f0f760 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.316579 Nov 19 19:27:08.988840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 141/271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:08.994625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:08.995812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:09.005788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:09.006275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:09.008719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:09.009408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:09.127038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb9242bc-6150-4832-9c10-2f86b5b8fa0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 24142 microversion: 2.1 time: 0.135956 Nov 19 19:27:09.127843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 142/272] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:08 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 24142 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:09.136132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:09.137849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:09.173114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:09.180851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:09.182697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:09.183525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:09.201632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:09.226706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8400fd35-a992-41d5-a358-0067e5bb1d60 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.476995 Nov 19 19:27:09.228372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 131/273] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:08 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:09.309456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ccef899-0363-4c80-ad97-705ce8f7ee6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 24316 microversion: 2.20 time: 0.180096 Nov 19 19:27:09.311093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 143/274] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:09 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 24316 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:09.996032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:09.996647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:10.003961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.004422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.005777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.006648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.139492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:10.140598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:10.152537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.153029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.154619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.155063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.170024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:10.178979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d4446eed-6131-4490-aa1a-15daab444223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.186574 Nov 19 19:27:10.181287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 132/275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:10.245049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:10.246756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:10.263994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.264669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.266531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9686612c-9e27-473e-9500-68772bf3fc2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 25030 microversion: 2.1 time: 0.127154 Nov 19 19:27:10.267208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.267968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 144/276] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:10 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 25030 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:10.274529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.331547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:10.333926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:10.351616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.351616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.354916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:10.357852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:10.478918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9a36c990-3481-4ada-8101-daf04453501f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 25350 microversion: 2.20 time: 0.159984 Nov 19 19:27:10.479575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 145/277] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:10 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 25350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:10.487654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1413888914", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "f1cdaedb-a1f8-428f-bcba-cc1d26efc01c"}]}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:10.561559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] validate_networks() for [('f1cdaedb-a1f8-428f-bcba-cc1d26efc01c', None, None, None, None, None)] {{(pid=116111) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:27:10.661423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:10.671334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a2bc72bc-4932-41f0-989b-3ef9ec084467 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.429941 Nov 19 19:27:10.671934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 133/278] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:10 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:11.214660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:11.216976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:11.236220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.236864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.238069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.238669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.345938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Flavor limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:27:11.347357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Image limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:27:11.348345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Flavor pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:27:11.348829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Image pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:27:11.349458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:27:11.359772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.360465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.363203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.363702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.390012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Getting quotas for project f61b72e190f44f579af38f0dd53b9677. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:11.399243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Getting quotas for user 3d3462073007465e9154b15c23f8cddf and project f61b72e190f44f579af38f0dd53b9677. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:11.425938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Going to run 1 instances... {{(pid=116111) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:27:11.429115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:27:11.510527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:11.521669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bcb8a4ab-2355-4fd2-9a79-da54cdcf7d07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.326972 Nov 19 19:27:11.523788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 134/279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:11.537285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:11.538686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:11.546404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.547185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.548183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.548801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.550937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dfbe9178-24d3-46f2-9311-b7e2fb653973 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069817 Nov 19 19:27:11.556805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 146/280] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:27:10 2021] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:27:11.587860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:11.589909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:11.604622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.605385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.608077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.608580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.685851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-af3a623e-0a7b-4223-92ca-f71f6ac5f64f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 26008 microversion: 2.1 time: 0.159548 Nov 19 19:27:11.686270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 135/281] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:11 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 26008 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:11.695825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c8865124-3957-4060-b0ba-37f012174326 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:11.696539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c8865124-3957-4060-b0ba-37f012174326 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:11.725175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-82e4241f-76f7-4118-a852-61fd58709e9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 26107 microversion: 2.20 time: 0.158445 Nov 19 19:27:11.726824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 147/282] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:11 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 26107 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:11.734783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:11.735694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:11.750559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.751392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.753109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:11.753900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:11.829875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8865124-3957-4060-b0ba-37f012174326 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:11.843225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c8865124-3957-4060-b0ba-37f012174326 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1219 microversion: 2.1 time: 0.151555 Nov 19 19:27:11.843723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 136/283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:11 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:12.002506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:12.011004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9520fed1-5b19-477e-b1e4-a7cce6c15c1f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.282788 Nov 19 19:27:12.011585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 148/284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:11 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:12.538597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:12.539337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:12.548048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.548609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.549261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.549689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.700161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:12.701406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:12.726835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.729617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.730888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.733409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.816067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:12.825549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-447acd37-201e-4590-8082-e22332a59208 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.290887 Nov 19 19:27:12.826986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 137/285] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:12.832120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:12.833712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:12.840924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.841907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.842976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.843641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.884909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a47298da-70c2-4a59-8e15-6dd3aa1ded25 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 26596 microversion: 2.1 time: 0.189907 Nov 19 19:27:12.886245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 149/286] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:12 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 26596 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:12.891714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:12.892656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:12.901836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.902329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.903381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:12.903818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:12.966532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8edef5a0-1324-4284-a621-5c60c84e5df1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 26736 microversion: 2.20 time: 0.136032 Nov 19 19:27:12.971032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 138/287] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:12 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 26736 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:13.000910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:13.011184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8b1f6a70-e227-420c-bb33-929e199390b3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1271 microversion: 2.1 time: 0.123346 Nov 19 19:27:13.012193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 150/288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:12 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1271 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:13.030113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:13.030672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:13.047786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.049467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:13.050571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.052992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:13.175527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-74f3b670-ffb1-4333-9c0e-35659984bfe7 req-592a78c6-7664-4359-a3e0-744e0a3a7e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9a8b1e-63df-4ecb-b090-cc77517dac92", "name": "network-vif-plugged", "status": "completed", "tag": "ea619087-b804-4ac0-bda5-f98356052e0f"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:13.177674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:27:13.177674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:27:13.195365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-74f3b670-ffb1-4333-9c0e-35659984bfe7 req-592a78c6-7664-4359-a3e0-744e0a3a7e8b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.195991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-74f3b670-ffb1-4333-9c0e-35659984bfe7 req-592a78c6-7664-4359-a3e0-744e0a3a7e8b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:13.227021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-74f3b670-ffb1-4333-9c0e-35659984bfe7 req-592a78c6-7664-4359-a3e0-744e0a3a7e8b service nova] Creating event network-vif-plugged:ea619087-b804-4ac0-bda5-f98356052e0f for instance cb9a8b1e-63df-4ecb-b090-cc77517dac92 on hv-cinder-77703 Nov 19 19:27:13.236700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-74f3b670-ffb1-4333-9c0e-35659984bfe7 req-592a78c6-7664-4359-a3e0-744e0a3a7e8b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065185 Nov 19 19:27:13.237476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 151/289] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:27:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:27:13.464095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:13.476547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e19b5d4-42a6-4436-ba01-660326a94371 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.448846 Nov 19 19:27:13.488333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 139/290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:13 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:13.844554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:13.845950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:13.856690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.858447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:13.859775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.860414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:13.897948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:13.905135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:13.922247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.923808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:13.924776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:13.926109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.061550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e01564e-f2f8-4287-9627-016734895818 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 27010 microversion: 2.1 time: 0.167291 Nov 19 19:27:14.067911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 140/291] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:13 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 27010 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:14.076784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:14.077813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:14.099199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:14.099836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.100651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:14.105330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.226861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:14.235856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-92d566ed-4728-4ab5-8fed-6c738d4116bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.395576 Nov 19 19:27:14.236433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 152/292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:14.256803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:14.257637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:14.264533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:14.265289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.266257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:14.266830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.350337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:14.366432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3bbab061-f91c-4036-978b-f433bfd2ae21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1277 microversion: 2.1 time: 0.115266 Nov 19 19:27:14.379227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 153/293] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:14 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1277 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:14.415998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e63d6bc-0f29-4484-97ed-510500fa37c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 27311 microversion: 2.20 time: 0.346186 Nov 19 19:27:14.418529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 141/294] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:14 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 27311 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:14.492690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:14.493616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:14.502151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:14.506843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.507902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:14.508472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:14.965177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:14.974578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba6339c7-965e-4ed8-8a00-c5eba24c4b0c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.485340 Nov 19 19:27:14.975179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 154/295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:14 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:15.077268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:15.079467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:15.103481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.106395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.107565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.108920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.256582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:15.256582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:15.265571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.266220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.267065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.267702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.402039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88378711-37d8-4bba-a0da-380f5233a52d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 27521 microversion: 2.1 time: 0.330429 Nov 19 19:27:15.404736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 142/296] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:15 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 27521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:15.414888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:15.425073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:15.449478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.450266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.451188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.454083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.554131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:15.565546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4f30c288-a763-4e46-b4f0-5308aa97f0c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.313900 Nov 19 19:27:15.568306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 155/297] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:15.575260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:15.576591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:15.589419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.590267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.591827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:15.592669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:15.722745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6f61e13-a1f7-48d3-bd18-2111661a8426 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 27605 microversion: 2.20 time: 0.151466 Nov 19 19:27:15.724381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 156/298] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:15 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 27605 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:15.914389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:15.926800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4c0e8aa1-77cd-47d7-95bf-3a1255614a77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.520230 Nov 19 19:27:15.928180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 143/299] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:15 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:16.001879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:16.002754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:16.031145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.032558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.033869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.034861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.414754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:16.415742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:16.425870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.426529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.427407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.433284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.525007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:16.544725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d003db0b-553e-4748-9be3-cdcb12dcc468 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1318 microversion: 2.1 time: 0.556601 Nov 19 19:27:16.546988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 157/300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:15 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:16.560298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-92a5ac5d-517d-40ec-842f-99945fd75bfb req-ff8b233d-5c8a-4418-9225-2b39a12a03f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e13558fb-6c01-4fec-8683-7cf251c8e43e", "tag": "831c9419-7682-4f8b-8024-53d869ac69e1"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:16.561836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:27:16.561836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:27:16.569593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a41d8d50-3608-49f7-8407-f87002a2bb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 27657 microversion: 2.1 time: 0.158927 Nov 19 19:27:16.570814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-92a5ac5d-517d-40ec-842f-99945fd75bfb req-ff8b233d-5c8a-4418-9225-2b39a12a03f4 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.570975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 144/301] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:16 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 27657 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:16.571616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-92a5ac5d-517d-40ec-842f-99945fd75bfb req-ff8b233d-5c8a-4418-9225-2b39a12a03f4 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.587971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:16.588265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:16.598550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.599855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.600829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.601269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.606721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-92a5ac5d-517d-40ec-842f-99945fd75bfb req-ff8b233d-5c8a-4418-9225-2b39a12a03f4 service nova] Creating event network-changed:831c9419-7682-4f8b-8024-53d869ac69e1 for instance e13558fb-6c01-4fec-8683-7cf251c8e43e on hv-cinder-77703 Nov 19 19:27:16.611947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-92a5ac5d-517d-40ec-842f-99945fd75bfb req-ff8b233d-5c8a-4418-9225-2b39a12a03f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063195 Nov 19 19:27:16.612611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 158/302] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:27:16 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:27:16.741765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:16.743090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:16.755203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.755847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.756642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.757065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.931658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fbdcc031-d97a-4bb1-bf35-2f84be379cad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 27720 microversion: 2.20 time: 0.199308 Nov 19 19:27:16.932304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 159/303] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:16 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 27720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:16.945978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:16.947221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:16.961482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.961927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.980409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:16.985714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:16.991897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:17.057007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23e486b8-cc07-4f45-a2d7-afe20c21ef5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.473730 Nov 19 19:27:17.062960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 145/304] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:17.300631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:17.309935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3f4b41f4-ebad-42e1-a35e-d532b323351b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.368808 Nov 19 19:27:17.310619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 160/305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:17.564158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:17.565543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:17.574190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:17.575093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:17.581381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:17.584792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:17.589048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:17.590429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:17.599349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:17.602029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:17.603352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:17.604012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:17.821672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:17.833808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-272a542d-3432-4740-9191-de5c8ae6cf8e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1507 microversion: 2.1 time: 0.271310 Nov 19 19:27:17.834972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 146/306] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:17 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1507 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:17.943505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:17.944487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:17.957386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:17.957904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:17.958830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:17.959280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:20.425884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e5f31a6-d8af-427e-b1a4-4d7560e383ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28031 microversion: 2.20 time: 2.485762 Nov 19 19:27:20.426667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 147/307] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:17 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28031 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:20.437463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:20.438269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:20.445589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:20.446377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5f260b1-aee2-4c8f-9def-44dcda8385ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 27777 microversion: 2.1 time: 2.868908 Nov 19 19:27:20.446946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:20.447914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:20.448505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:20.450969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 161/308] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:17 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 27777 bytes in 2874 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:20.457921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:20.458647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:20.466465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:20.466832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:20.467622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:20.468049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:20.822254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:20.828926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:20.831800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f149a31e-b440-4c62-94cb-4b4ee526cd79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1521 microversion: 2.1 time: 0.398340 Nov 19 19:27:20.832677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 148/309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:20.849511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2bf288f8-282a-4586-b138-9fc35de82bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.397220 Nov 19 19:27:20.862456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 162/310] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:20 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:21.068522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-133c9638-cd19-4f1d-9f2f-19b034c4928d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Action: 'create', calling method: .version_select at 0x7fc14850d550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1022611157"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:21.085092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-133c9638-cd19-4f1d-9f2f-19b034c4928d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Getting quotas for project 6216e18ee04d426a8334b064bb569a66. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:21.090825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-133c9638-cd19-4f1d-9f2f-19b034c4928d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Getting quotas for user 696f302fac2d4ef49c8d6b2826168610 and project 6216e18ee04d426a8334b064bb569a66. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:21.337742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-133c9638-cd19-4f1d-9f2f-19b034c4928d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Getting quotas for project 6216e18ee04d426a8334b064bb569a66. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:21.346591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-133c9638-cd19-4f1d-9f2f-19b034c4928d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Getting quotas for user 696f302fac2d4ef49c8d6b2826168610 and project 6216e18ee04d426a8334b064bb569a66. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:21.386465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-133c9638-cd19-4f1d-9f2f-19b034c4928d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.539031 Nov 19 19:27:21.386465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 149/311] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Nov 19 19:27:20 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:21.438866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:21.441006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:21.449761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.450983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.453796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.454589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.458476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:21.460216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:21.468882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.469977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.470998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.472127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.634232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de1f305b-880b-43a2-8d4b-4297049c1771 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28147 microversion: 2.20 time: 0.198620 Nov 19 19:27:21.640439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 163/312] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:21 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28147 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:21.675657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96f7693c-6a1f-4893-a48b-2f7d890d8d96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28121 microversion: 2.1 time: 0.220843 Nov 19 19:27:21.676806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 150/313] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:21 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28121 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:21.677961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04f93665-9f28-45d6-b580-33b7f1b382de"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:21.684335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:21.697011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.697438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.698276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.698910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.854850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:21.862095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:21.885751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.891332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:21.892803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:21.897122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.152533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e2a90ca-5103-4e10-aa7d-ea04f16c60c6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.469220 Nov 19 19:27:22.155400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 164/314] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:27:21 2021] POST /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:27:22.166326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:22.169730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:22.191917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.193060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.194346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.195085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.328308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:22.341744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ed6edae2-a220-4127-accb-e49f9333f137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1501 microversion: 2.1 time: 0.495315 Nov 19 19:27:22.358106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 151/315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:22.370548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d20a13f-c95d-4169-8328-ca8aaa999eb4"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:22.371640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:22.387774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.388236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.389047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.389493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.444801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] HTTP exception thrown: Cannot 'attach_volume' instance 38904995-d04e-4db1-93b4-52153ee2c2e2 while it is in vm_state rescued Nov 19 19:27:22.445693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Returning 409 to user: Cannot 'attach_volume' instance 38904995-d04e-4db1-93b4-52153ee2c2e2 while it is in vm_state rescued {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:27:22.446758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d886206-6287-410e-92d2-32a350bb72a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.080450 Nov 19 19:27:22.447854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 152/316] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:27:22 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 19 19:27:22.457532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:22.458761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:22.475165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.475899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.477710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.478520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.565532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:22.578035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2a12e8fd-d0d8-475b-8040-945b3994effc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.417508 Nov 19 19:27:22.579690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 165/317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:22 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:22.621830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b59e680-9dd4-4300-96ee-564ceddfbf66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.169044 Nov 19 19:27:22.626648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 153/318] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:22 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:22.632824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:22.636873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:22.649149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.649945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.651726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.652455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.669605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:22.673849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:22.692490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.695608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.696707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.697139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.811157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bf0dbf72-26e6-4fc7-ae4c-c24602e6df40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28147 microversion: 2.20 time: 0.159321 Nov 19 19:27:22.817281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 154/319] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:22 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28147 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:22.823853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:22.825240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:22.833264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.834159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.835176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:22.835886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:22.859198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:22.868373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5256a05f-aa91-40c0-bdbd-ee0fac99ec7b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1509 microversion: 2.1 time: 0.241134 Nov 19 19:27:22.873823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 166/320] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1509 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:22.962952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5096ed1c-7c25-42e0-9fe8-710082a04abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28183 microversion: 2.1 time: 0.143564 Nov 19 19:27:22.968770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 155/321] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:22 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:23.611170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:23.611782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:23.620425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.621575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.622410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.623006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.825212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:23.826434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:23.841250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.853838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.855381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.855823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.878417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:23.888224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-69d4c2f2-f792-47f4-802a-c9427cb8453a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.286137 Nov 19 19:27:23.889585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 167/322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:23 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:23.900540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:23.902435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:23.919536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.919979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.920761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.921362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.961581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2011d6c6-ba00-4eba-b1bb-9227109baf8f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28147 microversion: 2.20 time: 0.141213 Nov 19 19:27:23.962277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 156/323] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:23 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28147 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:23.981044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:23.982089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:23.991637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.992096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:23.992892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:23.993325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:24.104167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c20ec095-3024-4480-83e1-12ae560eba47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28183 microversion: 2.1 time: 0.126646 Nov 19 19:27:24.105600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 157/324] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:23 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:24.111724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:24.120201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a529da4-eda0-4c07-9c52-c0ae8a1354cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1509 microversion: 2.1 time: 0.229358 Nov 19 19:27:24.120777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 168/325] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:24.908560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:24.909444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:24.918499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:24.924618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:24.926890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:24.927550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:24.973890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:24.974918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:24.981158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:24.981610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:24.982403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:24.983151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:25.094931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-48271c94-a198-4622-a2b4-dd0c9381ba83 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28432 microversion: 2.20 time: 0.124803 Nov 19 19:27:25.099588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 169/326] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:24 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28432 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:25.121401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:25.132257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a5c42d66-a41c-4b8b-a6f0-d7ff7bad6ffc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.228746 Nov 19 19:27:25.132971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 158/327] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:25.138821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:25.140798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:25.148642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:25.149348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:25.151052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:25.151561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:25.152410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:25.152898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:25.156485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:25.157050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:25.158033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:25.158611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:25.274762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ec6c2df7-74f0-4222-bd6d-1de7049f1eb2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28373 microversion: 2.1 time: 0.162296 Nov 19 19:27:25.275587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 170/328] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:25 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:25.311730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:25.319831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-104aa08b-36ac-48ab-90ee-98657bfce044 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1509 microversion: 2.1 time: 0.175793 Nov 19 19:27:25.320850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 159/329] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1509 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:26.108298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:26.109337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:26.118366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.118812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.119602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.120030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.152931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:26.153789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:26.167176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.167888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.169161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.169574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.256564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0280976d-cea3-4911-988e-4c9d0fed600b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28432 microversion: 2.20 time: 0.152175 Nov 19 19:27:26.257226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 171/330] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:26 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28432 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:26.287421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:26.288452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:26.297428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.297965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.298783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.299211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.414908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:26.422943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e325da95-1198-4981-bc15-d5eb3634f857 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.275415 Nov 19 19:27:26.423838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 160/331] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:26 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:26.430982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:26.431958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:26.438942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ab01989-41b4-4a37-9edf-5f7a862a95ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28470 microversion: 2.1 time: 0.155477 Nov 19 19:27:26.443391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 172/332] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:26 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:26.443603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.443603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.443603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:26.443603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:26.599588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:26.609722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bae4f4c2-98d9-4bd9-ae69-049865fa1833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1509 microversion: 2.1 time: 0.184604 Nov 19 19:27:26.620966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 161/333] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:27.269000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:27.270273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:27.279632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.280389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.281447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.282127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.422869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-deb5ad62-7e52-40b3-943c-43ccc01bb68a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28486 microversion: 2.20 time: 0.157713 Nov 19 19:27:27.423563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 173/334] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:27 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28486 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:27.450255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:27.451516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:27.451629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:27.452814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:27.460120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.460972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.462030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.462701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.466810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.467254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.468032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.468456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.560611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c903ee97-ba91-4af9-8993-a9177b2b18cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28470 microversion: 2.1 time: 0.113508 Nov 19 19:27:27.561862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 174/335] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:27 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28470 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:27.630343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:27.640152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:27.647672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.648120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.648917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:27.649352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:27.782897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:27.802346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dc07e1c4-1eff-4769-bbd5-affe2b4c1f5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.356248 Nov 19 19:27:27.803631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 162/336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:27 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:28.020082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:28.028937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a50ebe97-a055-473b-90db-b257b3af7f9b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1515 microversion: 2.1 time: 0.403403 Nov 19 19:27:28.028937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 175/337] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1515 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:28.435599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:28.436758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:28.444169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:28.451327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:28.452983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:28.453833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:28.574954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:28.576003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:28.581232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c69cbef-2304-42b8-83a6-0de89488f1e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.149777 Nov 19 19:27:28.583109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 163/338] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:28 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:28.585734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:28.586426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:28.587456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:28.588107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:28.714868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5ce5f897-c195-4829-838e-82f2ed91f0ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.143551 Nov 19 19:27:28.721433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 176/339] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:28 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:28.833753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:28.840298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:28.853532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:28.854464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:28.855554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:28.856323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.168509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:29.184849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a45fb15-07c8-42c3-9991-9b628d32e429 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.367957 Nov 19 19:27:29.185460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 164/340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:28 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:29.450078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:29.452296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:29.462095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.463574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.464817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.465492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.593179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:29.594982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:29.619879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.620341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.621158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.621590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.743619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-69174265-cae1-46d5-a4a2-ab5109e861b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.154239 Nov 19 19:27:29.748891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 165/341] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:29 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:29.762523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-b466dbdd-5b20-4098-961f-399289b1a48c req-676c930a-5f6a-46e4-9b0d-91b9b2576ede service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13558fb-6c01-4fec-8683-7cf251c8e43e", "name": "network-vif-plugged", "status": "completed", "tag": "831c9419-7682-4f8b-8024-53d869ac69e1"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:29.766131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:27:29.766131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:27:29.776968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-b466dbdd-5b20-4098-961f-399289b1a48c req-676c930a-5f6a-46e4-9b0d-91b9b2576ede service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.778155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-b466dbdd-5b20-4098-961f-399289b1a48c req-676c930a-5f6a-46e4-9b0d-91b9b2576ede service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.794986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-b466dbdd-5b20-4098-961f-399289b1a48c req-676c930a-5f6a-46e4-9b0d-91b9b2576ede service nova] Creating event network-vif-plugged:831c9419-7682-4f8b-8024-53d869ac69e1 for instance e13558fb-6c01-4fec-8683-7cf251c8e43e on hv-cinder-77703 Nov 19 19:27:29.800603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-b466dbdd-5b20-4098-961f-399289b1a48c req-676c930a-5f6a-46e4-9b0d-91b9b2576ede service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049564 Nov 19 19:27:29.801858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 166/342] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:27:29.810420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:29.811772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:29.830505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.831200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.832778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.833892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.902144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:29.911819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7be99b6-072b-4e3d-9e5d-f48633559ce3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1515 microversion: 2.1 time: 0.466735 Nov 19 19:27:29.930537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dbaff6df-537c-4826-aa22-68e41fb5b8d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.125711 Nov 19 19:27:29.930769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 177/343] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1515 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:29.936243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d3888cd-5226-4f80-a3d7-29cb2a2bf2ea"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:29.936905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 167/344] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:29 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:29.943483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:29.965012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.965598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:29.966551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:29.967094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:30.133262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-847951716", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "c78e7b75-b174-443c-b78e-86db23075f67"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:30.446797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-df451012-095b-4432-b469-0e43a090b874 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.514034 Nov 19 19:27:30.454122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 178/345] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:27:29 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:27:30.464585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:30.472066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:30.502120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:30.503761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:30.510523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:30.512039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:30.867126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:30.877899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-925dede8-492c-4ab5-a0d9-db6fb046f9ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.420800 Nov 19 19:27:30.896718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 179/346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:30.917007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:30.917992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:30.923836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:30.924278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:30.925046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:30.925470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:31.030853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6b3f00a6-1cf4-4062-b521-b13e562e4612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.122536 Nov 19 19:27:31.034759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 180/347] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:30 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:31.039703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:31.042111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:31.052790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:31.053614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:31.054619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:31.055119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:31.171322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bfc7b651-0ca5-47c1-8a2b-d5d09d28c633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.137285 Nov 19 19:27:31.171997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 181/348] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:31 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:31.914153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:31.914849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:31.921835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:31.922969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:31.923140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:31.923493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:32.124028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:32.133340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7d196b8-d272-4ba5-9e52-31c16a5ae0d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1319 microversion: 2.1 time: 0.224009 Nov 19 19:27:32.134082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 182/349] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:32.139232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:32.140954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:32.148218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:32.148893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:32.149677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:32.150131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:32.274977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-55274737-c040-412b-afe9-19533c93ec60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.139337 Nov 19 19:27:32.278365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 183/350] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:32 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:32.280563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:32.281559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:32.294762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:32.295212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:32.295999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:32.296426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:32.418354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-07f7ecad-f370-49e5-8041-4cfa83172406 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.140739 Nov 19 19:27:32.419642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 184/351] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:32 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:32.764083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] validate_networks() for [('c78e7b75-b174-443c-b78e-86db23075f67', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:27:33.154825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:33.156713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:33.170796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.171659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.173214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.173887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.521333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:33.532188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:27:33.532655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:27:33.533323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:27:33.534124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:27:33.534739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:27:33.546155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cf4d881b-5ec3-495e-9b39-9b04768c8feb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1509 microversion: 2.1 time: 0.398398 Nov 19 19:27:33.549501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 185/352] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:33 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1509 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:33.564608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.569072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:33.569908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.571017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.571663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.576997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:33.589742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.592231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.594624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.606909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.624218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:33.633790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for user 4df88e053d6049e9bee5470199b7295d and project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:33.661117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:27:33.663914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:27:33.714564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a6bc087-8e01-41c1-80c4-1fc8c38e66d9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.162933 Nov 19 19:27:33.721554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 186/353] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:33 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:33.729472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:33.733144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:33.742526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.743427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.745287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:33.746089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:33.754855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1d83eecb-faca-41a5-8042-f4e35c334695 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.625793 Nov 19 19:27:33.767488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 168/354] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:27:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 3642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 19:27:33.776882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ff3e2e50-16c9-40ee-94bf-708cf089aa15 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:33.777496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ff3e2e50-16c9-40ee-94bf-708cf089aa15 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:33.865520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35fbb4cb-8e1a-4ec3-bf63-a7b99ebc8a19 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.140799 Nov 19 19:27:33.866959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 187/355] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:33 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:33.903778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ff3e2e50-16c9-40ee-94bf-708cf089aa15 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:33.913733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ff3e2e50-16c9-40ee-94bf-708cf089aa15 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1217 microversion: 2.1 time: 0.140367 Nov 19 19:27:33.916712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 169/356] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:33 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:34.740195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:34.741606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:34.750401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:34.750872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:34.751658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:34.752117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:34.865279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95fb4423-17b3-4934-bfee-8645f2f8799e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.134182 Nov 19 19:27:34.872133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 188/357] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:34 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:34.878216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:34.879801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:34.898858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:34.899472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:34.900432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:34.900984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:34.935019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:34.936715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:34.959790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:34.961124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:34.964166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:34.964797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:35.027429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d37dbaa-0118-421d-845c-7b057dc2383e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.153013 Nov 19 19:27:35.029189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 170/358] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:34 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:35.147444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:35.157507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3ec6b56-f3b8-4ff1-b4fd-6dae34db0a0f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1269 microversion: 2.1 time: 0.228200 Nov 19 19:27:35.158703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 189/359] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:34 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1269 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:35.879969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:35.881068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:35.889778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:35.898652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:35.899953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:35.901317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:36.039430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:36.040527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:36.047746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:36.048467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:36.049579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:36.050223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:36.061227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c869655d-44d8-403d-a9f3-05ec93a1b867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.187628 Nov 19 19:27:36.062209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 171/360] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:35 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:36.179404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:36.180246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:36.197725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e598ceab-ba72-4523-89a4-0b8a8dfa0fe8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.161646 Nov 19 19:27:36.198563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 190/361] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:36 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:36.198873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:36.199627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:36.205897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:36.206998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:36.419488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:36.448008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07744e5d-c6f9-4a01-bca6-5a7000a30313 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1275 microversion: 2.1 time: 0.275727 Nov 19 19:27:36.459781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 172/362] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:36 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1275 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:37.075700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:37.077470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:37.084901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:37.085614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:37.086739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:37.087335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:37.219625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:37.224852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:37.229782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8424c4ee-e600-47e3-add8-c71aeeec5803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.158015 Nov 19 19:27:37.238688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 191/363] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:37 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:37.248704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:37.250641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:37.253697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:37.254819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:37.435812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6bcfcb33-aeb2-4a17-a455-89b1497713e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.227790 Nov 19 19:27:37.437643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 173/364] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:37 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:37.467215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:37.467938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:37.495368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:37.495820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:37.496620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:37.497051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:37.984639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:37.996369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9c7af8d2-b4ea-4105-8c41-ffac7ed682e7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.534195 Nov 19 19:27:37.999034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 192/365] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:37 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:38.185025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-d284d58a-d453-454d-9d73-aba3c2cbd298 req-427fb094-cd11-422d-b4e5-dec5c166c86c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f", "tag": "f82ab65b-821b-424a-8b41-fb4528d15f92"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:38.187049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:27:38.187049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:27:38.196510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-d284d58a-d453-454d-9d73-aba3c2cbd298 req-427fb094-cd11-422d-b4e5-dec5c166c86c service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:38.197478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-d284d58a-d453-454d-9d73-aba3c2cbd298 req-427fb094-cd11-422d-b4e5-dec5c166c86c service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:38.215734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-d284d58a-d453-454d-9d73-aba3c2cbd298 req-427fb094-cd11-422d-b4e5-dec5c166c86c service nova] Creating event network-changed:f82ab65b-821b-424a-8b41-fb4528d15f92 for instance 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f on hv-cinder-77703 Nov 19 19:27:38.221520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-d284d58a-d453-454d-9d73-aba3c2cbd298 req-427fb094-cd11-422d-b4e5-dec5c166c86c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040446 Nov 19 19:27:38.224092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 174/366] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:27:38.251675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:38.254992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:38.262137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:38.262591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:38.263378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:38.263839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:38.366467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35d3eb99-d6b3-4e4b-b9dd-0783bbe97099 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 28599 microversion: 2.20 time: 0.120847 Nov 19 19:27:38.370800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 193/367] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:38 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 28599 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:38.449793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:38.450985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:38.480059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:38.480265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:38.483498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:38.484127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:38.705370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-308d26c4-cb80-4526-82a0-a58c83f5069c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28637 microversion: 2.1 time: 0.260185 Nov 19 19:27:38.718108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 175/368] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:38 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28637 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:39.024999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:39.028127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:39.040203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.046112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.047235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.047841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.328582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:39.331491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:39.341064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.341522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.342352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.342950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.371667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lazy-loading 'flavor' on Instance uuid 38904995-d04e-4db1-93b4-52153ee2c2e2 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:27:39.412802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:39.420351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f3a60d66-f1b8-42ac-8342-34374e1fd19c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.409105 Nov 19 19:27:39.432527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 194/369] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:39 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:39.536983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d88f2264-2525-4739-ba89-4ecfc0c709d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action" status: 200 len: 32 microversion: 2.1 time: 0.215035 Nov 19 19:27:39.539200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 176/370] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:39 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:27:39.550731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:39.552461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:39.561189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.561730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.562675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.563334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.658683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4fd0daae-1156-465f-a992-d4c8c44ffccc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Action: 'create', calling method: .version_select at 0x7fc14849df70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1911179625"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:39.712486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de20c6ae-2ca3-437e-9972-ba10c6ad1498 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 29197 microversion: 2.20 time: 0.171387 Nov 19 19:27:39.713330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 177/371] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:39 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 29197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:39.719091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:39.719841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:39.729841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.730447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.731600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:39.732256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:39.853333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-4fd0daae-1156-465f-a992-d4c8c44ffccc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Getting quotas for project 62170a929e0f4fb5aad1a629f86de1f4. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:39.857957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-4fd0daae-1156-465f-a992-d4c8c44ffccc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Getting quotas for user 4cceacd1aa1e47a5bf03e02d2cf64fc3 and project 62170a929e0f4fb5aad1a629f86de1f4. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:40.190248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-4fd0daae-1156-465f-a992-d4c8c44ffccc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Getting quotas for project 62170a929e0f4fb5aad1a629f86de1f4. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:27:40.195288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-4fd0daae-1156-465f-a992-d4c8c44ffccc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Getting quotas for user 4cceacd1aa1e47a5bf03e02d2cf64fc3 and project 62170a929e0f4fb5aad1a629f86de1f4. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:27:40.216296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4fd0daae-1156-465f-a992-d4c8c44ffccc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.782406 Nov 19 19:27:40.216947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 195/372] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Nov 19 19:27:39 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:40.222262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:40.223656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:40.230014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:40.230484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:40.231323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:40.231686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:40.321285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:40.330390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-27cbda6c-522e-448e-8cc6-c528e012e197 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.615480 Nov 19 19:27:40.343668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 178/373] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:40.453282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:40.453895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:40.458188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b10a90c-6962-42b1-b914-a48eacdf10e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 28775 microversion: 2.1 time: 0.239712 Nov 19 19:27:40.462402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:40.462875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 196/374] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:40 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 28775 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:40.463381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:40.464570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:40.465287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:40.730265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:40.733725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:40.747097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:40.748583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:40.750711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:40.751549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:40.834988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:40.842645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1398abca-bc09-40a1-b440-c0a259982ac3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.405206 Nov 19 19:27:40.846557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 179/375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:40 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:40.973006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3a21b71-c2e7-4e84-88e5-1a7f053ed4a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 30640 microversion: 2.20 time: 0.250357 Nov 19 19:27:40.975874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 197/376] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:40 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 30640 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:41.350993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:41.351594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:41.358159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:41.358930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:41.359915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:41.360544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:41.475318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:41.476612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:41.490097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:41.490661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:41.491508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:41.491957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:41.553851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:41.575509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b30c8aeb-0d44-402d-8123-10e38c105024 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.217853 Nov 19 19:27:41.588054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 180/377] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:41.681674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8f9952c6-9da8-4e92-933f-d4ce03166091 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 29352 microversion: 2.1 time: 0.211372 Nov 19 19:27:41.686534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 198/378] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:41 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 29352 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:41.862431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:41.863122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:41.870573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:41.871017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:41.871806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:41.872232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:41.989457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:41.991883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:41.999988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:42.001237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:42.002386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:42.003062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:42.035067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:42.044955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ab5b411-302a-4ea9-9f3c-71f01155a9ee tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.186074 Nov 19 19:27:42.046465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 181/379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:41 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:42.134807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3fc9a14c-2144-45c9-8c93-b6cce8f4e12c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 32465 microversion: 2.20 time: 0.153128 Nov 19 19:27:42.135515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 199/380] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:41 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 32465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:42.602805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:42.604086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:42.612063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:42.612513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:42.613420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:42.614259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:42.695736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:42.696922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:42.704354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:42.704887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:42.705734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:42.706406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:42.760129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:42.768778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88fe25f6-c27d-47c6-aafd-d1dae71b5b14 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.179865 Nov 19 19:27:42.769615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 182/381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:42.850354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-835b027f-58d2-44f7-89ca-bd79791698ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 30171 microversion: 2.1 time: 0.159130 Nov 19 19:27:42.852866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 200/382] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:42 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 30171 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:43.063381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:43.064115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:43.071151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.071607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.072399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.072834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.147845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:43.148948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:43.156064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.156600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.157575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.158026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.222531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:43.231865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-93924f69-020f-42d2-9fd3-686e380ec498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.172450 Nov 19 19:27:43.232662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 183/383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:43 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:43.290070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f453334-eeea-45ca-89f1-fb9521fa2774 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 32916 microversion: 2.20 time: 0.146458 Nov 19 19:27:43.291714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 201/384] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:43 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 32916 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:43.793219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:43.793219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:43.797810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.798286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.799166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.799534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.863337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:43.864112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:43.875809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.876594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.877690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:43.878350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:43.944930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:43.952813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c25b5e6-cf64-4938-b425-c9df3145a56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.170312 Nov 19 19:27:43.953374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 184/385] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:44.048682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83b1a05a-50b2-4bdf-83b4-a414332cf482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 30766 microversion: 2.1 time: 0.189519 Nov 19 19:27:44.049359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 202/386] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:43 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 30766 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:44.249196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:44.249817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:44.257779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:44.258267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:44.259060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:44.259484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:44.306982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:44.307816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:44.315757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:44.316363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:44.318296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:44.318733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:44.426292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:44.436641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-31154681-9341-47c1-9217-0645c5371859 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.191183 Nov 19 19:27:44.437222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 185/387] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:44 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:44.973467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:44.974129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:44.980522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:44.980981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:44.981761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:44.982273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:45.279763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:45.292388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3e7eda3-d9cb-4722-89ee-71b50a87481d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.322853 Nov 19 19:27:45.293284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 186/388] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:45.298372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:45.299345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:45.305750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:45.306234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:45.307018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:45.307444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:49.002590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe502627-a43f-4859-9fbe-1238b7d79893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 36113 microversion: 2.20 time: 4.701845 Nov 19 19:27:49.003236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 203/389] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:44 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 36113 bytes in 4704 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:27:49.008071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:49.008908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:49.017101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:49.017541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:49.018346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:49.018778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:49.020654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e247580-c557-4010-a41a-a7ab9a347102 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 33990 microversion: 2.1 time: 3.725605 Nov 19 19:27:49.021337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 187/390] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:45 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 33990 bytes in 3728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:49.027690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:49.028383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:49.036906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:49.037355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:49.038953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:49.039326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:49.224526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:49.226722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:49.234963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bd7b8274-2d91-4eba-b9c4-e43c42073800 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.230186 Nov 19 19:27:49.235150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e10cc64-79f3-4910-8127-e346714343f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.212717 Nov 19 19:27:49.235912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 204/392] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:49 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:49.236029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 188/392] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:50.015565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:50.016493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:50.023197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.023666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.024844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.025289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.034178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:50.035108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:50.041828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.042287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.043096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.044287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.172436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c41a51aa-da23-4e04-805c-cfe3c1338f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 36359 microversion: 2.20 time: 0.160339 Nov 19 19:27:50.173088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 205/393] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:50 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 36359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:50.193807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d36e180a-0834-4242-a546-512cff209160 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 34321 microversion: 2.1 time: 0.164460 Nov 19 19:27:50.194600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 189/394] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:50 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 34321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:50.253445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:50.254075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:50.256168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:50.261252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:50.261449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.261559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.262409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.262820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.264963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.265657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.266556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:50.267052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:50.476132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:50.484238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:50.487894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b50b1577-18c1-42f9-99e4-40e324365b7c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.238574 Nov 19 19:27:50.488590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 206/395] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:50.492538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd830899-d629-4946-b444-a1779155948a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.240711 Nov 19 19:27:50.503087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 190/396] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:50 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:51.184457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:51.185369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:51.192550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.192999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.193752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.194250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.211789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:51.213436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:51.221577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.222475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.222845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.223281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.348125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bd508fef-6d71-409e-9775-fe34cba6ff1d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 36602 microversion: 2.20 time: 0.167061 Nov 19 19:27:51.349592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 207/397] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:51 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 36602 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:51.379368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd6a2098-54c5-4756-96df-5f65feb51189 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 34574 microversion: 2.1 time: 0.176628 Nov 19 19:27:51.380034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 191/398] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:51 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 34574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:27:51.505326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:51.506024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:51.511356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:51.512281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:51.513380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.513828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.514646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.515254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.521970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.522296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.523414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:51.524021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:51.713907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:51.722996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8f71d4fc-5580-4599-af8f-4cd761c554dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.221602 Nov 19 19:27:51.723558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 208/399] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:51.737969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:51.745662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59066346-a8b7-40bd-9269-c01ce4e2eee2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.238545 Nov 19 19:27:51.746254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 192/400] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:51 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:52.360912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:52.361823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:52.368881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.369332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.370802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.370802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.392300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:52.393317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:52.400142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.400589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.401374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.401806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.490672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c5e3655-cfab-4941-8154-4ade255a50fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 36892 microversion: 2.20 time: 0.133281 Nov 19 19:27:52.491786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 209/401] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:52 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 36892 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:52.538481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b6862651-421f-46e1-955f-127a94d3a491 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 34938 microversion: 2.1 time: 0.150399 Nov 19 19:27:52.539138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 193/402] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:52 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 34938 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:52.742200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:52.742939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:52.750732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.751409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.752432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.752855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.765259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:52.765872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:52.773153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.773597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.774424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:52.774895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:52.972950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:52.976072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:52.981416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4792ced-46e5-4326-97fa-9fbbbfed7c2b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.243489 Nov 19 19:27:52.982102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 210/403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:52.984681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-68bb88da-7f9e-4240-9fb8-1b439056c562 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.223429 Nov 19 19:27:52.985253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 194/404] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:52 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:53.504226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:53.505868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:53.513130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:53.513581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:53.514403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:53.514924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:53.550256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:53.551183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:53.558318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:53.558765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:53.559578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:53.559966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:53.681230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8c2dd03c-c47b-422a-b747-cefca1337f43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37289 microversion: 2.20 time: 0.181795 Nov 19 19:27:53.681882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 211/405] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:53 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37289 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:53.711482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-641b97a1-801e-4388-af48-d48386a57abc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 35261 microversion: 2.1 time: 0.165103 Nov 19 19:27:53.712127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 195/406] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:53 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 35261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:54.001290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:54.002029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:54.002743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:54.003454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:54.009535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.009985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.010770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.011081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.011227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.011711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.012404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.012802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.227375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:54.230688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:54.235579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c45f30c-a892-43f4-83c3-27da94dc5d87 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.237108 Nov 19 19:27:54.236158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 196/407] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:53 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:54.238920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27bedfc3-6915-467b-8ad6-724160fdf118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.242435 Nov 19 19:27:54.239474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 212/408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:54.693922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:54.697014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:54.704082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.704752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.705358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.705816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.724482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:54.725424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:54.732328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.733074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.734404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:54.734489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:54.862526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-583b16d6-9eed-4de4-8228-d754dd10aa22 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37596 microversion: 2.20 time: 0.172382 Nov 19 19:27:54.863163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 197/409] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:54 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37596 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:54.898288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-50528325-5d5c-4d65-98c4-79c3f8aed876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 35452 microversion: 2.1 time: 0.177805 Nov 19 19:27:54.899014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 213/410] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:54 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 35452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:55.254367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:55.256185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:55.260589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:55.261277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:55.264419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.265177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.265945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.266361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.268273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.268723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.269584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.270038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.481096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:55.484834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:55.489553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5bd51b81-7a47-4b8b-a186-2221d577cacc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.232994 Nov 19 19:27:55.490277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 214/411] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:55.493324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd69cb7c-3fe8-4f10-9b1a-0ca6b4fbfe19 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.244085 Nov 19 19:27:55.493894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 198/412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:55 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:55.875034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:55.875508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:55.882282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.882654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.883427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.883854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.911065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:55.911972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:55.918865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.919530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.920520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:55.921263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:55.998732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8b7b26b-68f9-4865-a2e1-bd5cff59aa9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37811 microversion: 2.20 time: 0.127636 Nov 19 19:27:56.000200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 215/413] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:55 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37811 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:56.064840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c9226393-fe76-4535-873b-4492da98d6d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 35734 microversion: 2.1 time: 0.157245 Nov 19 19:27:56.065554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 199/414] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:55 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 35734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:56.508403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:56.509043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:56.513306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:56.514057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:56.518108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:56.518619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:56.519406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:56.519833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:56.521535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:56.521991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:56.522821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:56.523259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:56.719661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:56.724932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:56.733615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8f15817-dd69-4a7b-8742-9b828bca25d7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.225584 Nov 19 19:27:56.734235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 200/415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:56 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:56.739279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1cfa8b25-a068-4c62-adc2-85c4173314c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.235073 Nov 19 19:27:56.740458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 216/416] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:57.012585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:57.013547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:57.020703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.021171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.021965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.022424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.077725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:57.078907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:57.085629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.086081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.086893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.087324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.177741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0401e1ab-00d1-4624-984c-12d33373c91e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37811 microversion: 2.20 time: 0.168279 Nov 19 19:27:57.178537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 201/417] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:57 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37811 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:57.242625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-24a8dc83-bfb0-4e3e-aa3c-e56bf4c9f398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 36105 microversion: 2.1 time: 0.168922 Nov 19 19:27:57.243330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 217/418] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:57 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 36105 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:57.754505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:57.755546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:57.758298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:57.758998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:57.764262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.765087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.766331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.767094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.768124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.768660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.769513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:57.770167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:57.993128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:58.001916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:58.002665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5aaa9a1a-5a89-43b7-9963-afa9d3776580 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.255101 Nov 19 19:27:58.003327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 202/419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:57 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:58.010815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cc3a98ff-5530-47e8-8a6e-5eb9214478c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.257165 Nov 19 19:27:58.011555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 218/420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:58.191708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:58.192568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:58.199611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:58.200059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:58.200848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:58.201283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:58.254402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:58.255613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:58.261847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:58.262586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:58.263350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:58.263776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:58.301155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d88e5a9-68ab-4119-aed0-d3dc3b9ff298 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37811 microversion: 2.20 time: 0.113269 Nov 19 19:27:58.301777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 203/421] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:58 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37811 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:58.390196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d5a93bad-b55d-4f10-b7e0-25f961bac0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 36591 microversion: 2.1 time: 0.139094 Nov 19 19:27:58.390779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 219/422] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:58 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 36591 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:27:59.023948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:59.025086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:59.032693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:27:59.033850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:59.036214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.036954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.038312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.039023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.044832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.045610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.047381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.047854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.276447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:59.281431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:27:59.284792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b4d5ac6-2191-4677-9a5b-112368895788 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.267682 Nov 19 19:27:59.285392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 204/423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:59 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:27:59.290413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb5be9f1-853e-4305-a064-3bf1cf5b4b26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.264890 Nov 19 19:27:59.291045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 220/424] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:27:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:27:59.312945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:59.313787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:59.320522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.321018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.321863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.322348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.402378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:27:59.403302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:27:59.409885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.410358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.411125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:27:59.411547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:27:59.422576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f8bc5c71-3489-4f92-9200-90b2df80a004 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37811 microversion: 2.20 time: 0.113224 Nov 19 19:27:59.423617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 205/425] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:27:59 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37811 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:27:59.520808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-56c1fd96-ba1d-4f2b-9ad2-da937117f94e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 37057 microversion: 2.1 time: 0.121894 Nov 19 19:27:59.521430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 221/426] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:27:59 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 37057 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:00.302186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:00.302983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:00.307577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:00.309674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:00.316707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.318644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.319082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.319415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.319894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.320219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.320315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.320835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.520536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:00.523794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:00.528667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-82c520c0-ea39-490e-93e4-b90ad2b19d11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.225194 Nov 19 19:28:00.529290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 222/427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:00.532088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0f5ded69-d2b7-4eb9-b689-4d489a3a74cb tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.234076 Nov 19 19:28:00.532657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 206/428] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:00 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:00.534194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:00.535290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:00.537616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:00.538761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:00.543566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.544012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.544809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.544935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.545230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.545324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.546279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:00.546874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:00.696328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6f09855a-ab2d-4c1d-9d9a-4ef76a0ae1a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 37551 microversion: 2.1 time: 0.162132 Nov 19 19:28:00.696906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 207/429] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:00 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 37551 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:00.726809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af09df55-e88a-477e-848c-d0b8c934c24e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37886 microversion: 2.20 time: 0.196204 Nov 19 19:28:00.727460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 223/430] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:28:00 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37886 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:28:01.554331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:01.554830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:01.555202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:01.555292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:01.560908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.561428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.562705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.563028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.563499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.564106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.565744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.566203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.760538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:01.767674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:01.769237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-118b3bee-1b89-4808-a338-c115de8b4361 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.225796 Nov 19 19:28:01.779037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 208/431] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:01.779037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:01.779330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-554b3cd2-30b7-4294-8698-3a8ea1935e3e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.230920 Nov 19 19:28:01.779444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:01.782352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.782889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.783744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.784251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.785263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 224/432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:01 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:01.789885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:01.790816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:01.796819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.797256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.797985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.798659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.934615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-056dbaf9-103c-4a14-acca-a9d2a376dd63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 200 len: 37947 microversion: 2.20 time: 0.147942 Nov 19 19:28:01.935280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 225/433] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:28:01 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 37947 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:28:01.945621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:01.946129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:01.953529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.953971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.954796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:01.955226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:01.964145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3db87145-d1c7-4183-b9ee-12d106a9555b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 37938 microversion: 2.1 time: 0.192509 Nov 19 19:28:01.965394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 209/434] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:01 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 37938 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:01.980565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb0e1f13-d827-4e7e-b831-c0bbf2a33f4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/ips" status: 200 len: 152 microversion: 2.20 time: 0.038841 Nov 19 19:28:01.981134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 226/435] 10.222.0.46 () {60 vars in 1288 bytes} [Fri Nov 19 19:28:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:02.787349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:02.788647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:02.792281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:02.793502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:02.795912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:02.796618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:02.797662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:02.798468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:02.801192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:02.801736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:02.802607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:02.803185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:03.029542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:03.037883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2b6c14b8-d551-4c9e-bb4f-a2468fccf34b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.249711 Nov 19 19:28:03.041806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 227/436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:02 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:03.047459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:03.048474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:03.058166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:03.060825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:03.061188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:03.062108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:03.062543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:03.070357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c82d3a9-b4e5-4e03-816c-cfc4d96c1802 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.287995 Nov 19 19:28:03.071109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 210/437] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:03.175814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0c389b00-fd9b-4b7f-8add-fb35a0cf34e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 37938 microversion: 2.1 time: 0.132232 Nov 19 19:28:03.176956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 228/438] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:03 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 37938 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:04.055537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:04.056166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:04.063447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:04.063896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:04.064898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:04.065094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:04.089547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:04.090302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:04.101606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:04.102536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:04.103587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:04.104236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:04.251654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:04.262645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9b28474a-92d3-4ac8-bfab-c5dd309af4b6 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.210765 Nov 19 19:28:04.263225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 211/439] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:04 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:04.268585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:04.269536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:04.276588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:04.277055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:04.277828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:04.278291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:04.296346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:04.305338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62a01e62-2f8d-44e9-ac71-77914d5f8665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.220167 Nov 19 19:28:04.305921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 229/440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:05.280289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:05.280956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:05.288234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:05.288675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:05.289460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:05.289917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:05.430454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:05.438569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-592f4ec4-69c0-49d9-b853-7fd6759cda8c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.161979 Nov 19 19:28:05.439161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 230/441] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:05 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:05.443482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:05.444085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:05.450364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:05.450812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:05.451579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:05.452007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:05.588769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:05.599531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c823a630-d2eb-432c-bb39-f3712591e609 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.157400 Nov 19 19:28:05.599531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 231/442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:06.456029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:06.456727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:06.463365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:06.463801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:06.464570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:06.464980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:06.596366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:06.604003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-48fc77b3-4889-459b-bf51-c971a6d49343 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.151811 Nov 19 19:28:06.604605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 232/443] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:06 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:06.614451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:06.615041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:06.621129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:06.621577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:06.622396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:06.622828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:06.764983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:06.773894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef0371f0-6f15-4cd6-b37d-746dead3fc72 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.163216 Nov 19 19:28:06.774506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 233/444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:07.482468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2dfdcfc0-9a8c-460c-87c4-126b7dcfa961 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 37938 microversion: 2.1 time: 3.217888 Nov 19 19:28:07.483149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 212/445] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:04 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 37938 bytes in 3219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:07.622004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:07.622640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:07.629915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:07.630392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:07.631268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:07.631691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:07.770776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:07.778860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b53d0493-b3f6-47d5-8f3f-83b5e5f1b982 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.160859 Nov 19 19:28:07.779424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 234/446] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:07 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:07.792149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:07.792843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:07.800345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:07.800945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:07.801880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:07.802409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:07.950020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:07.957697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:07.958220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:07.958432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8aa54aea-272f-4d54-8b88-8cd11d2b3ef6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.170299 Nov 19 19:28:07.958992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 213/447] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:07.964638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:07.965129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:07.965911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:07.966371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:07.991362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lazy-loading 'flavor' on Instance uuid 35ef8da0-cc9a-484a-b675-ce4bbc67b34d {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:28:08.493694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:08.494909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:08.504229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:08.504669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:08.505478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:08.505918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:08.621719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48bcdf10-c784-436e-9442-45b5e78dfc39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 37941 microversion: 2.1 time: 0.131629 Nov 19 19:28:08.622405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 214/448] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:08 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 37941 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:28:08.796595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:08.797357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:08.805481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:08.805933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:08.806773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:08.807242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:08.944814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:08.952900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e3963f6-cdd4-4b07-b3e2-2481dce8beb1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.160422 Nov 19 19:28:08.953454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 215/449] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:08 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:08.976651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:08.977148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:08.983275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:08.983717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:08.984562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:08.984971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:09.118997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:09.127516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c9341a77-a327-40d0-838d-4bc23dc7d8ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.154469 Nov 19 19:28:09.128078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 216/450] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:09.633258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:09.634449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:09.642732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:09.644019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:09.645509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:09.646014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:09.769120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2286ccb9-12d1-451b-8e21-01f3b5eb82fb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 38067 microversion: 2.1 time: 0.139833 Nov 19 19:28:09.775173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 217/451] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:09 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 38067 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:28:09.783642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:09.784229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:09.791538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:09.792058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:09.792786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:09.793220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:09.818644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8a5010fc-86f9-47d2-bb14-26dba269efd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/ips" status: 200 len: 145 microversion: 2.1 time: 0.039483 Nov 19 19:28:09.819237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 218/452] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Nov 19 19:28:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:28:09.970491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:09.971525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:09.978422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:09.978874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:09.979666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:09.980106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:10.124523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:10.132379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bdb93e82-c968-492b-bb0c-27385d0f918a tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.166081 Nov 19 19:28:10.132975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 219/453] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:09 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:10.144947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:10.145556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:10.152566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:10.153021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:10.153820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:10.154370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:10.291243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:10.300677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e90c1eba-79ba-46db-9095-36a3164ddd5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.159843 Nov 19 19:28:10.301672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 220/454] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:11.150261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:11.151016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:11.158000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:11.158483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:11.159282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:11.159719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:11.530812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:11.539421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ff15ace-a570-4ef9-acaf-2e24b2f606ff tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.392859 Nov 19 19:28:11.540053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 221/455] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:11 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:11.544501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:11.545140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:11.551654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:11.552074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:11.552867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:11.553298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:11.686304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:11.695490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7a95870-1133-4b08-9dc2-9e50a1ed53d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.154266 Nov 19 19:28:11.697097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 222/456] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:12.560748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:12.561803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:12.572399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:12.573089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:12.574795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:12.575519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:12.783847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:12.791899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1d102c57-c0b3-4229-8e4e-81130d164e53 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.237121 Nov 19 19:28:12.792497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 223/457] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:12 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:12.796934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:12.797550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:12.804554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:12.805006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:12.805843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:12.806316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:12.960021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:12.971882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbd8f4de-c13a-4062-a153-e8540bb43d06 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.178320 Nov 19 19:28:12.972530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 224/458] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:13.247685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b01e443-a918-4a97-b84e-713155e48d8e"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:13.248835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:13.256160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:13.256616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:13.257489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:13.257860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:13.608560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd2f7b72-544c-4751-a1e9-6dc4d57af9da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364179 Nov 19 19:28:13.611277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 225/459] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:28:13 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:28:13.823980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:13.825219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:13.837271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:13.838390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:13.840089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:13.841024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:14.033911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:14.044839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c4ccdd9-9936-41ea-8a12-4b6f5742bf79 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.231697 Nov 19 19:28:14.045539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 226/460] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:13 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:14.053878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-97da22f1-95c1-47be-8b6e-11f339f62191 req-852c8bfd-7095-402c-9615-77ed70d1f779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f", "name": "network-vif-plugged", "status": "completed", "tag": "f82ab65b-821b-424a-8b41-fb4528d15f92"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:14.057050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:14.057050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:28:14.066858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-97da22f1-95c1-47be-8b6e-11f339f62191 req-852c8bfd-7095-402c-9615-77ed70d1f779 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:14.067377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-97da22f1-95c1-47be-8b6e-11f339f62191 req-852c8bfd-7095-402c-9615-77ed70d1f779 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:14.082199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-97da22f1-95c1-47be-8b6e-11f339f62191 req-852c8bfd-7095-402c-9615-77ed70d1f779 service nova] Creating event network-vif-plugged:f82ab65b-821b-424a-8b41-fb4528d15f92 for instance 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f on hv-cinder-77703 Nov 19 19:28:14.087145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-97da22f1-95c1-47be-8b6e-11f339f62191 req-852c8bfd-7095-402c-9615-77ed70d1f779 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039990 Nov 19 19:28:14.087754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 227/461] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:14.092726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:14.093458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:14.100844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:14.101301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:14.102156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:14.102599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:14.291642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:14.305839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-29ca6959-6ed2-4e59-b456-f0e91195044b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.216371 Nov 19 19:28:14.306925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 228/462] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:15.070334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:15.071133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:15.079104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:15.079629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:15.080476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:15.080952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:15.227525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:15.236660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c42fafed-af79-4aaa-947d-2ee4c9dbe4a1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.169950 Nov 19 19:28:15.237240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 229/463] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:15 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:15.327286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:15.327954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:15.336922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:15.337390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:15.338296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:15.338747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:15.484803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:15.492991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9fcf571a-cfee-47ad-9d22-2a3fc2916bb1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.169777 Nov 19 19:28:15.493559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 230/464] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:16.256495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:16.256495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:16.267409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:16.267868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:16.268704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:16.269140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:16.409670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:16.417248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-53103bcf-a22e-4466-8ece-48a747bbf49e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1317 microversion: 2.1 time: 0.166251 Nov 19 19:28:16.417839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 231/465] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:16 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:16.511448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:16.513282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:16.524137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:16.525059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:16.526089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:16.526813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:16.695975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:16.706384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f34ba71f-e41a-4abf-b402-653ae2f4dc2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.200295 Nov 19 19:28:16.707279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 232/466] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:17.438642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:17.439565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:17.449475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.450202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.451396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.452039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.597539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:17.606338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-70f9886a-2ef6-4da2-8bae-af70c92a4584 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1506 microversion: 2.1 time: 0.174923 Nov 19 19:28:17.607023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 233/467] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:17 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:17.628853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04f93665-9f28-45d6-b580-33b7f1b382de"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:17.629975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:17.636651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.637092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.637886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.638337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.723456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] HTTP exception thrown: Invalid volume: volume 04f93665-9f28-45d6-b580-33b7f1b382de is already attached to instances: cb9a8b1e-63df-4ecb-b090-cc77517dac92 Nov 19 19:28:17.724278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Returning 400 to user: Invalid volume: volume 04f93665-9f28-45d6-b580-33b7f1b382de is already attached to instances: cb9a8b1e-63df-4ecb-b090-cc77517dac92 {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:28:17.725292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07afbefe-6950-4ba5-b0c6-8a682fdcec4c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100361 Nov 19 19:28:17.725917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 234/468] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:28:17 2021] POST /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:28:17.730672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:17.731274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:17.738537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.738984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.739747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.740179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.894724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:17.908703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5d922233-57dd-465d-ba63-34075f153efa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.181322 Nov 19 19:28:17.915805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 235/469] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:17.922516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:17.923485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:17.933592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.934348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:17.935713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:17.936690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:18.108319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lazy-loading 'services' on Instance uuid cb9a8b1e-63df-4ecb-b090-cc77517dac92 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:28:18.321571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-408cad65-aaf4-47f9-9932-c165e965191c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments/04f93665-9f28-45d6-b580-33b7f1b382de" status: 202 len: 0 microversion: 2.1 time: 0.409757 Nov 19 19:28:18.323609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 236/470] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:28:17 2021] DELETE /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments/04f93665-9f28-45d6-b580-33b7f1b382de => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:28:18.348091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:18.350460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:18.361310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:18.362061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:18.363482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:18.364208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:18.404148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-07d2cd21-1870-42ee-8378-4390b35fbaa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 202 len: 0 microversion: 2.20 time: 10.449520 Nov 19 19:28:18.405326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 235/471] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:28:07 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 0 bytes in 10452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:28:18.419425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:18.421173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:18.422368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-791e7e3b-bec2-4c2a-ad0a-ffcbdfceec28 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082727 Nov 19 19:28:18.423193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 237/472] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:18 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:18.432680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:18.433301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:18.434737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:18.435572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:18.609297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:18.620257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:18.621978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:18.623182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0bc4e75-0ae8-48b9-8abf-36a6f92ee468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.212978 Nov 19 19:28:18.624204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 236/473] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:18.926596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:18.927185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:18.934145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:18.934678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:18.935459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:18.935895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:19.093245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:19.108013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e75e80df-8789-4c15-9b88-f0de9f1f9073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.184789 Nov 19 19:28:19.109032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 238/474] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:19.434861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:19.435848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:19.442787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:19.443237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:19.444046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:19.444479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:19.475836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-90229ac1-e081-4200-8b60-dd82e248fa64 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Nov 19 19:28:19.476447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 237/475] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:19 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:19.642405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:19.643039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:19.649239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:19.649686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:19.651314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:19.652032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:19.813548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:19.821952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:19.823451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:19.824619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f00e7cee-5463-43bf-88a5-c9b8d44cf9c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.186287 Nov 19 19:28:19.825188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 239/476] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:20.126384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:20.127133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:20.133552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:20.133901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:20.134717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:20.135148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:20.284756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:20.293306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e114b61-ff5c-47b3-aa6f-13742816bf1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.171141 Nov 19 19:28:20.293859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 238/477] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:20.492390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:20.494175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:20.505881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:20.506725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:20.508109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:20.508880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:20.570724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7ef53a7-85ac-417c-913a-ae53158d344b tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085133 Nov 19 19:28:20.571797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 240/478] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:20 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:20.844717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:20.845287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:20.852391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:20.852838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:20.853612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:20.854069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:21.001375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:21.009509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:21.011212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:21.012411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88ac3e33-094a-4534-8382-2f7dff2c285b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.171881 Nov 19 19:28:21.013053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 239/479] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:21.311396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:21.312221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:21.318821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:21.319289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:21.320131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:21.320561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:21.480921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:21.489446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a369a3ab-3e95-409e-b435-95fe9ee39e4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.182322 Nov 19 19:28:21.490028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 241/480] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:21.583721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:21.584659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:21.590980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:21.591416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:21.592183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:21.592606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:21.626916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31520cce-2cda-441a-9364-98b793f57f7e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046800 Nov 19 19:28:21.627377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 240/481] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:21 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:22.031209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:22.032034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:22.039119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.039587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.040360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.040793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.190319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:22.198382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:22.200170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:22.201432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5fff256d-0516-4ea4-ae26-6b9b7da72670 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.174318 Nov 19 19:28:22.202000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 242/482] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:22.289066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc0a3af2-0ae5-45d8-ae0d-bb75bb0c1f63 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:22.297069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc0a3af2-0ae5-45d8-ae0d-bb75bb0c1f63 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.297790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc0a3af2-0ae5-45d8-ae0d-bb75bb0c1f63 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.364102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc0a3af2-0ae5-45d8-ae0d-bb75bb0c1f63 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Going to try to stop instance {{(pid=116111) force_stop /opt/stack/nova/nova/compute/api.py:2654}} Nov 19 19:28:22.428227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc0a3af2-0ae5-45d8-ae0d-bb75bb0c1f63 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 202 len: 0 microversion: 2.1 time: 0.142524 Nov 19 19:28:22.432164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 241/483] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:22 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:28:22.441957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:22.443486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:22.450235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.450822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.451760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.452333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.509114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:22.509962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:22.517473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.518029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.518960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.519401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.647439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:22.658786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dc1f06ab-8a4c-4171-ac70-d3bdc309e0e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.224123 Nov 19 19:28:22.659556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 243/484] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:22.666761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:22.668428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:22.678859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.679544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.680940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:22.681718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:22.720012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-58fd37af-0326-49a6-9234-eb3163725498 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058945 Nov 19 19:28:22.721265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 244/485] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:22 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:22.723170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:22.731209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f87d16dc-20a8-4eb2-ba10-143b9c950bd7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.226476 Nov 19 19:28:22.731766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 242/486] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:23.221930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:23.222605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:23.230033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.230506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.231306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.231739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.380466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:23.388648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:23.390681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:23.392179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-30e26203-a2e7-4b74-b6d7-592ed891363e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.175113 Nov 19 19:28:23.392751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 245/487] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:23.677195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:23.677856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:23.684935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.685387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.686223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.686658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.732142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:23.733475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:23.740567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.741452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.742495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.742931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.790134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3399f7c1-78e0-4453-80f7-b1a61bbd3cc7 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061779 Nov 19 19:28:23.790921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 246/488] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:23 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:28:23.795335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:23.796144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:23.803155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.803685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.804665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:23.804851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:23.841650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:23.850784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88052665-516b-4eaa-933d-e5851e79cdd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.177377 Nov 19 19:28:23.851370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 243/489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:24.013428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:24.023479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-141b14e2-c583-4499-8d27-4641e56dd3b1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.231503 Nov 19 19:28:24.026843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 247/490] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:24.032567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1556334091", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "c78e7b75-b174-443c-b78e-86db23075f67"}]}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:24.411743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:24.412981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:24.425675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:24.426145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:24.426996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:24.427428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:24.581212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:24.593872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:24.597082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:24.599147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc545f01-c5cf-41c2-9c31-a08e0f8e1965 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.190929 Nov 19 19:28:24.600039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 248/491] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:24.868939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:24.869442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:24.876549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:24.876991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:24.877776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:24.878268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:25.025751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:25.035007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-606ab136-c134-4a21-b2a3-3df76d3569bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.169668 Nov 19 19:28:25.035603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 249/492] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:25.041359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:25.041944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:25.050222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:25.050646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:25.051461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:25.051886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:25.197918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:25.206651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c48a3a29-55e9-4921-b4c7-1d2a0d25995f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.169143 Nov 19 19:28:25.207473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 250/493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:25.617408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:25.618151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:25.625519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:25.626359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:25.627255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:25.627834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:25.775338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:25.784149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:25.785615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:25.786811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b925de7f-6472-4012-995d-56ca3665d65f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.173312 Nov 19 19:28:25.787381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 251/494] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:26.054489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:26.055089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:26.061449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:26.062073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:26.062910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:26.063335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:26.207753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:26.220419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46a01b0b-70e6-4a21-bce7-e34a1e289fac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.169880 Nov 19 19:28:26.221343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 252/495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:26.225597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:26.226402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:26.232288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:26.232738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:26.233513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:26.233947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:26.383070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:26.392277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9a95f13b-c98b-42c7-80d3-c7069a9e66c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.169957 Nov 19 19:28:26.392869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 253/496] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:26.805031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:26.805741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:26.812140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:26.812607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:26.813384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:26.813812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:26.965117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:26.974237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:26.975712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:26.976922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-93fcad97-833d-41b4-a6b5-390f6f645d85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.175658 Nov 19 19:28:26.977484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 254/497] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:27.239236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:27.239915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:27.246553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:27.246997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:27.247862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:27.248293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:27.433058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:27.442562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-696469ba-1edc-4f36-a2bf-21fb7670c59e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.207123 Nov 19 19:28:27.443275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 255/498] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:27.448149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:27.448730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:27.455894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:27.456335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:27.457117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:27.457544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:27.621037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:27.633471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04d61d4c-7b82-4b32-96e7-5904d73f41a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.188773 Nov 19 19:28:27.634312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 256/499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:27.641083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1845221460", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1022611157", "security_groups": [{"name": "tempest-secgroup-smoke-359842867"}], "networks": [{"uuid": "1e81bb56-dd21-4287-86bd-eebb64db701d"}], "block_device_mapping_v2": [{"uuid": "1ed7e231-f3e2-418a-a74c-fea1a988dba6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:27.779405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] validate_networks() for [('1e81bb56-dd21-4287-86bd-eebb64db701d', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:28:28.261746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:28:28.262665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:28:28.263364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:28:28.264065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:28:28.264649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:28:28.275611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:28.276043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:28.277144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:28.277617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:28.296986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Getting quotas for project 6216e18ee04d426a8334b064bb569a66. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:28:28.301736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Getting quotas for user 696f302fac2d4ef49c8d6b2826168610 and project 6216e18ee04d426a8334b064bb569a66. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:28:28.379821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:28:28.384967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1ed7e231-f3e2-418a-a74c-fea1a988dba6',volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:28:28.538420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b2c34fa-f6d0-450b-9ae1-a6b5b2666124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.902541 Nov 19 19:28:28.539136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 257/500] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:28:27 2021] POST /compute/v2.1/servers => generated 405 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:28:28.544077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:28.544682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:28.552263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:28.552734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:28.553526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:28.553960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:28.723626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:28.734695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:28.736536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:28.738490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-67cac4d2-6fbd-48ec-8c7c-a6874a72c8c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.197888 Nov 19 19:28:28.739135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 258/501] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:28.743982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:28.744636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:28.751883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:28.752360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:28.753384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:28.754161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:28.929819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:28.941573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc3e5d4c-7e28-4f6f-bba3-8d5a3c957498 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.201075 Nov 19 19:28:28.954341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 259/502] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:28.954341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-98e7fac6-66e4-45e0-beef-2514b8d138ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:28.954341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-98e7fac6-66e4-45e0-beef-2514b8d138ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:29.013035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-98e7fac6-66e4-45e0-beef-2514b8d138ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:29.021311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-98e7fac6-66e4-45e0-beef-2514b8d138ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1089 microversion: 2.1 time: 0.077089 Nov 19 19:28:29.034323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 260/503] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:29.034323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:29.034323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:29.038443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:29.038976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:29.039927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:29.040402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:29.212789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:29.223340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1910095-e289-47af-b12c-66505ccdb7ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.199492 Nov 19 19:28:29.223933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 261/504] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:29.761778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:29.762529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:29.774572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:29.775311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:29.776400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:29.776854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:29.939086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:29.947621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:29.949090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:29.950278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8101c9bb-09c9-4ba0-a3ab-d944787cbea4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.193486 Nov 19 19:28:29.950835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 262/505] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:29.969632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:29.970322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:29.977662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:29.978202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:29.979024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:29.979501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:30.138580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:30.150354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c876d47-ff42-4b80-831f-344ac057afcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.187135 Nov 19 19:28:30.151373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 263/506] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:30.161917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:30.163118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:30.175975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:30.176882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:30.178215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:30.179246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:30.296764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:30.305106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4905d61d-d273-4063-8d50-c8af3f277878 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1195 microversion: 2.1 time: 0.152301 Nov 19 19:28:30.305736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 264/507] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1195 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:30.310339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:30.310996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:30.318133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:30.318638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:30.319488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:30.319964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:30.628168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:30.637247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7d83de1f-e482-4063-a5fe-9c49c40a97bc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.330377 Nov 19 19:28:30.638132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 265/508] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:30.978018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:30.979852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:30.992109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:30.993094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:30.994498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:30.995265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:31.402960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:31.415069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:31.416506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:31.417688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-21fb83a5-193d-425b-9931-a7201a2f0651 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.446882 Nov 19 19:28:31.418304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 266/509] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:31.436023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:31.437601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:31.447972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:31.448610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:31.449512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:31.450164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:31.730697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:31.739244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e57a1be5-af8d-4d5d-8635-cfb9a6cdb974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.311215 Nov 19 19:28:31.739932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 267/510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:31.744404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:31.745009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:31.753015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:31.753462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:31.754290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:31.754719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.046378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:32.054838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d6dc9f05-6663-45b9-b7e7-d3aff01c238e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.313922 Nov 19 19:28:32.055517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 268/511] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:32.060652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:32.061366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:32.068076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.068607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.069475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.069978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.332461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:32.347307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b571e4ce-809e-4598-a274-87d335966c69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.290380 Nov 19 19:28:32.351426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 269/512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:32.438737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:32.439482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:32.448011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.449051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.450491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.450994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.716180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:32.742674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:32.744928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:32.746384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6c144c78-e994-4335-9881-39eb39dfa371 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.313380 Nov 19 19:28:32.756989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 270/513] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:32.756989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-13f18c94-ee8d-406e-9fc5-b1f24240ba59 req-873e0c19-be85-4b48-a375-e5ff96c8eaed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1894db7d-c20a-4bcc-8fd3-cf13d214a5ae", "tag": "52339b2d-1214-4a37-8df2-c8f15a213a8a"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:32.760366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:32.760366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:28:32.774285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-13f18c94-ee8d-406e-9fc5-b1f24240ba59 req-873e0c19-be85-4b48-a375-e5ff96c8eaed service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.774744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-13f18c94-ee8d-406e-9fc5-b1f24240ba59 req-873e0c19-be85-4b48-a375-e5ff96c8eaed service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.793959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-13f18c94-ee8d-406e-9fc5-b1f24240ba59 req-873e0c19-be85-4b48-a375-e5ff96c8eaed service nova] Creating event network-changed:52339b2d-1214-4a37-8df2-c8f15a213a8a for instance 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae on hv-cinder-77703 Nov 19 19:28:32.802824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-13f18c94-ee8d-406e-9fc5-b1f24240ba59 req-873e0c19-be85-4b48-a375-e5ff96c8eaed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053812 Nov 19 19:28:32.804015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 271/514] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:32.812491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:32.813401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:32.822325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.823029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:32.823972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:32.824534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:33.330242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:33.344371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-55b20842-6b4b-4922-a216-0eef29007956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.538563 Nov 19 19:28:33.345072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 272/515] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:33.353959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:33.353959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:33.362624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:33.363250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:33.364298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:33.364951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:33.599548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:33.610730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-24c7b4c8-bc9a-48c9-a5a3-6390ac996307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.263302 Nov 19 19:28:33.613033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 273/516] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:33.617714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:33.618712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:33.625249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:33.625667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:33.626859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:33.627435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:33.849668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:33.861494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9fc6b3e-9a9f-4f92-92aa-bab4e5206bed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.247649 Nov 19 19:28:33.862331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 274/517] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:33.870158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:33.870984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:33.884654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:33.885625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:33.887414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:33.888199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:34.125370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:34.137032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:34.138645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:34.139902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c38b5f16-a0f3-419c-8bb3-69dc3fddb511 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.276233 Nov 19 19:28:34.140977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 275/518] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:34.363608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:34.364291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:34.370974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:34.371484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:34.372351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:34.372766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:34.548992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:34.557518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-253c02ec-aab2-4ce0-a13c-d6de36b1fe1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.197865 Nov 19 19:28:34.558141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 276/519] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:34.632086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:34.632640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:34.639440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:34.640070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:34.641021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:34.641464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:34.826736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:34.835075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef5d0f28-daf0-42ae-b001-a48e5e4c02cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.207604 Nov 19 19:28:34.835664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 277/520] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:34.880355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:34.880970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:34.887785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:34.888142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:34.889028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:34.889674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:35.058965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:35.068694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd71cea0-c496-471c-9869-5ce04812c488 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.192397 Nov 19 19:28:35.069307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 278/521] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:35.159102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:35.161881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:35.170590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:35.171092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:35.171993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:35.172439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:35.341170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:35.349453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:35.351127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:35.352342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c2ad9d3a-44d8-4c36-93b8-dd47530f8848 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.197502 Nov 19 19:28:35.352920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 279/522] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:35.576112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:35.578602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:35.583902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:35.584349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:35.585135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:35.585570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:35.739180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:35.748278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8005c0c7-852d-4ee0-b4a9-333e17324fd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.175761 Nov 19 19:28:35.748852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 280/523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:35.853679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:35.854299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:35.861511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:35.861959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:35.862778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:35.863212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.029661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:36.037791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85b276de-040d-43af-8955-3ac8639470e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.187894 Nov 19 19:28:36.038415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 281/524] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:36.089148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:36.090211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:36.100929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:36.101683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.103074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:36.103850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.274156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:36.282972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7826c52f-1bf5-4562-a0c5-43c4e9d0f915 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.198884 Nov 19 19:28:36.283601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 282/525] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:36.371384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:36.371987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:36.378971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:36.379424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.380221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:36.380658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.540736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:36.553085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:36.554621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:36.555829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-26009249-892c-4cac-b448-3eb5f074c631 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.188251 Nov 19 19:28:36.556398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 283/526] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:36.770927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:36.773444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:36.782794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:36.783352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.784322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:36.784985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:36.968965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:36.979111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7c7ff3fe-956b-4b84-8d2a-014e1e57b05d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.216139 Nov 19 19:28:36.979718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 284/527] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:37.056960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:37.057836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:37.067329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:37.067972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:37.069121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:37.069810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:37.219929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:37.227994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8f155c5-e14a-47b9-8a8e-419e5eb116d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.176241 Nov 19 19:28:37.228557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 285/528] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:37.301957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:37.302605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:37.312240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:37.312974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:37.314500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:37.315070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:37.488392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:37.502144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9298fb07-fc03-4e41-8129-6428c2dbf65d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.203846 Nov 19 19:28:37.503164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 286/529] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:37.582260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:37.583348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:37.593409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:37.593663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:37.594711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:37.595137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:37.760819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:37.769781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:37.771404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:37.772545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d07b2cb-2fb4-48ea-855b-05ffef3da6a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.196487 Nov 19 19:28:37.773082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 287/530] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:38.003227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:38.003839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:38.010634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.011169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.011985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.012441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.168425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:38.178027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e5274823-570d-4057-9425-bca781551bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.179488 Nov 19 19:28:38.178644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 288/531] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:38.247762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:38.249203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:38.258206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.258659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.259457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.259891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.443274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:38.452561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f66348c-2d64-4871-b77b-6ccd0cd40125 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.210900 Nov 19 19:28:38.457838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 289/532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:38.520795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:38.521322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:38.528549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.529086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.529890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.530517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.771451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:38.784829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e185d9b-7836-423b-9972-d7f93838b922 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.267993 Nov 19 19:28:38.785430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 290/533] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:38.796394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:38.797203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:38.805722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.806478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:38.807675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:38.808282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.088920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:39.099202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:39.100718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:39.102558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-274b7156-9f99-4eed-8a86-79e192325a76 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.313180 Nov 19 19:28:39.103288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 291/534] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:39.196823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:39.197439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:39.204865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:39.205316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.206280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:39.206721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.406286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:39.415520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c53da527-7005-479d-bc53-deae589ba40b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.222416 Nov 19 19:28:39.416115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 292/535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:39.477509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:39.478190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:39.484643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:39.485092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.485887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:39.486361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.638866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:39.647509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79579457-8fd7-415a-9f32-814f3199e73c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.173644 Nov 19 19:28:39.648102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 293/536] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:39.807561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:39.808530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:39.818611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:39.819076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.819918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:39.820389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:39.982630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:39.992221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-da630f9b-9c4a-41be-828f-7f359b4f1cf5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.191281 Nov 19 19:28:39.992797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 294/537] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:40.128508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:40.129610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:40.138389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:40.138971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:40.140016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:40.140575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:40.301201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:40.310610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:40.312254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:40.313443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0f1ea897-d21e-47f9-af96-1104832dd2d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.190322 Nov 19 19:28:40.314012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 295/538] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:40.438329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:40.438951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:40.445556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:40.445990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:40.446903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:40.447257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:40.604296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:40.613297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9922e411-f2c7-4a95-a732-43b23b282bb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.179430 Nov 19 19:28:40.613937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 296/539] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:40.666258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:40.666883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:40.674086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:40.674518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:40.675370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:40.675812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:40.838592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:40.847736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b99a10f3-9dab-4040-9227-ac8de42da98e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.185192 Nov 19 19:28:40.848331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 297/540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:41.016959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:41.017575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:41.024671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.025029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.025840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.026352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.169432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:41.177486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7fa11741-22a0-4aaf-9936-06e0301aa0c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.165829 Nov 19 19:28:41.178077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 298/541] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:41.332793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:41.333346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:41.340017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.340466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.341288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.341722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.487701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:41.496712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:41.498380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:41.499790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e4407b91-0b72-4552-a13c-34807d2b4feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.171270 Nov 19 19:28:41.500438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 299/542] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:41.631000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:41.631479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:41.638687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.639127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.640002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.640427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.811966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:41.820837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fdfc90a6-2026-4e0b-8090-ddcf71f6a86a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.193656 Nov 19 19:28:41.821407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 300/543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:41.867511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:41.868822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:41.881961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.882294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:41.883185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:41.883983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:42.028143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:42.036685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89eee685-5521-4e9f-9637-2d1efb31bb62 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.174687 Nov 19 19:28:42.037285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 301/544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:42.195606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:42.196421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:42.203393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:42.203845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:42.204683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:42.205128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:42.350660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:42.358609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df6bc6be-6a1a-4c18-8ad1-6b690759dec0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.166657 Nov 19 19:28:42.359517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 302/545] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:42.520185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:42.520185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:42.526491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:42.526936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:42.527778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:42.528212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:42.680464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:42.694610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:42.696111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:42.697374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-904acb2b-ff2c-4115-a760-0dee98426374 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.182146 Nov 19 19:28:42.702820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] validate_networks() for [('c78e7b75-b174-443c-b78e-86db23075f67', None, None, None, None, None)] {{(pid=116111) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:28:42.708676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 303/546] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:42.839554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:42.840741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:42.853051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:42.853497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:42.854364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:42.854805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.125075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.133577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c361fe0-c5e1-4d02-9e6e-b2db38a1a1e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.297833 Nov 19 19:28:43.142159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 304/547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:43.142159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:43.142159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:43.146462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.146920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.147715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.148127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.166694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:28:43.167202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:28:43.167758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:28:43.168151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:28:43.168574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:28:43.178069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.178520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.179309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.179756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.197227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:28:43.201484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for user 4df88e053d6049e9bee5470199b7295d and project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:28:43.214699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Going to run 1 instances... {{(pid=116111) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:28:43.217121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:28:43.266418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c99c139-fdf1-4511-9c90-4312db161aac tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.239097 Nov 19 19:28:43.267383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 244/548] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:28:24 2021] POST /compute/v2.1/servers => generated 380 bytes in 19241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:28:43.277781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-320970cb-5f14-4abe-b584-3482d0301dd1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:43.278915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-320970cb-5f14-4abe-b584-3482d0301dd1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:43.314196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.322889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-67a9427f-f485-41dc-91b1-7010da1732bf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.187154 Nov 19 19:28:43.323501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 305/549] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:43.341686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-320970cb-5f14-4abe-b584-3482d0301dd1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.350761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-320970cb-5f14-4abe-b584-3482d0301dd1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1218 microversion: 2.1 time: 0.077163 Nov 19 19:28:43.351462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 245/550] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:43 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:43.377167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:43.377812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:43.384232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.384682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.385514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.385949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.567594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.577623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e187c89-9f62-486e-b2ba-fb9743acfda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.204702 Nov 19 19:28:43.578582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 306/551] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:43.717019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:43.717900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:43.725245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.725692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.727144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:43.727772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:43.868844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.877949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.879518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:43.880702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06b888ad-aa4b-4341-8873-b904ca442b2a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1722 microversion: 2.20 time: 0.168610 Nov 19 19:28:43.881278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 246/552] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:44.150824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:44.151666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:44.158353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.158888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.159748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.160247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.302764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:44.310736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-db0e06fc-46bc-46d0-8611-60814355a596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.163586 Nov 19 19:28:44.311340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 307/553] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:44.340450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:44.341043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:44.354017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.354492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.355290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.355710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.373730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:44.374091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:44.382622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.383296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.384360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.385393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.459661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:44.467579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-58abdc8c-8ad4-484d-8541-0d6a99e0b900 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1270 microversion: 2.1 time: 0.101126 Nov 19 19:28:44.468215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 308/554] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:44 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:44.532468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:44.540277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8838e20-d7d0-4ba7-ae62-bb10efb08ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.203366 Nov 19 19:28:44.540817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 247/555] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:44.597106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:44.597715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:44.604315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.604768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.605556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.606009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.748014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:44.757153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d321823-d8ec-4745-a5cc-f3cd36dee807 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.164303 Nov 19 19:28:44.757718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 309/556] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:44.903918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:44.905668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:44.913687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.914714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:44.915489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:44.916249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.212145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:45.225014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:45.226593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:45.227781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-91e797e0-0807-4227-89e6-8433331e3443 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1743 microversion: 2.20 time: 0.329660 Nov 19 19:28:45.231241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 248/557] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1743 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:45.330321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:45.331073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:45.338741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.339273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.340130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.340630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.485389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:45.486035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:45.493140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.493786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.494747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.495330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.775373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:45.793433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6c86973e-0460-4c9b-95a9-7e9dae0878d8 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1276 microversion: 2.1 time: 0.311886 Nov 19 19:28:45.806160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 249/558] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:45 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1276 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:45.813623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:45.814810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:45.829975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.833059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.841069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.841424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.880771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:45.893747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c83346f-868f-4513-95ff-aed322410012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.568605 Nov 19 19:28:45.895968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 310/559] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:45.902883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:45.903776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:45.913535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.914539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:45.915854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:45.916644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.363594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:46.380172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0578fd6-fa94-4adc-8169-14c58a2bbffd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.578367 Nov 19 19:28:46.381061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 250/560] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:46.393521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-fd449fed-a357-4b3d-b188-eefa30a2125b req-6fe9c049-8267-49fd-81cd-cea8768dbeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1894db7d-c20a-4bcc-8fd3-cf13d214a5ae", "name": "network-vif-plugged", "status": "completed", "tag": "52339b2d-1214-4a37-8df2-c8f15a213a8a"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:46.395438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:46.395438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:28:46.404154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-fd449fed-a357-4b3d-b188-eefa30a2125b req-6fe9c049-8267-49fd-81cd-cea8768dbeb5 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.404697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-fd449fed-a357-4b3d-b188-eefa30a2125b req-6fe9c049-8267-49fd-81cd-cea8768dbeb5 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.423340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-fd449fed-a357-4b3d-b188-eefa30a2125b req-6fe9c049-8267-49fd-81cd-cea8768dbeb5 service nova] Creating event network-vif-plugged:52339b2d-1214-4a37-8df2-c8f15a213a8a for instance 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae on hv-cinder-77703 Nov 19 19:28:46.429659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-fd449fed-a357-4b3d-b188-eefa30a2125b req-6fe9c049-8267-49fd-81cd-cea8768dbeb5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041494 Nov 19 19:28:46.431410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 251/561] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:46.442751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:46.446470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:46.447951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:46.464088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3330883c-d142-438a-8334-78dbec217a4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.565620 Nov 19 19:28:46.465703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 311/562] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:46.469967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.471210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.475336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.476692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.829954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:46.830980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:46.837741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.838514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.839586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.840209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.846011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:46.881728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:46.893673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:46.906495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ab4b50c-552d-4db5-bb3e-3d3e2f729b51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1743 microversion: 2.20 time: 0.468592 Nov 19 19:28:46.908860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 252/563] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1743 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:46.935421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:46.935421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:46.967773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.972531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:46.973654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:46.976022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:47.455707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:47.466720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-471f3481-af02-48ed-a493-989ed1f21a57 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.641263 Nov 19 19:28:47.468328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 312/564] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:46 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:47.476554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:47.495534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:47.496638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:47.500462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27c0941e-7951-4d98-9b33-c57f66ac739d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1723 microversion: 2.1 time: 0.575852 Nov 19 19:28:47.501533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 253/565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1723 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:47.514009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:47.515085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:47.518453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:47.519147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:47.521019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:47.521781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:47.529531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:47.530792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:47.532214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:47.533039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:47.884603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:47.899202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:47.899769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c3a4f959-f22f-4aea-92fa-ccd954c5448a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.417488 Nov 19 19:28:47.900641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 313/566] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:47.909441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8adfbc91-5374-405b-bd8a-95759f5e85fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.403125 Nov 19 19:28:47.922446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 254/567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:47.938770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:47.939339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:47.947372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:47.947798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:47.949179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:47.949818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.172087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-1771454b-9ff6-46f9-8c39-80d67ce470db req-ee6d3e7d-24a8-44af-b23d-63bb97278ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44827b1f-caee-49a9-a965-3b186454972f", "tag": "1d493c07-2d7d-41c0-9104-2f6c85143734"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:48.174340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:48.174340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:28:48.183001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-1771454b-9ff6-46f9-8c39-80d67ce470db req-ee6d3e7d-24a8-44af-b23d-63bb97278ede service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.183731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-1771454b-9ff6-46f9-8c39-80d67ce470db req-ee6d3e7d-24a8-44af-b23d-63bb97278ede service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.201171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-1771454b-9ff6-46f9-8c39-80d67ce470db req-ee6d3e7d-24a8-44af-b23d-63bb97278ede service nova] Creating event network-changed:1d493c07-2d7d-41c0-9104-2f6c85143734 for instance 44827b1f-caee-49a9-a965-3b186454972f on hv-cinder-77703 Nov 19 19:28:48.207674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-1771454b-9ff6-46f9-8c39-80d67ce470db req-ee6d3e7d-24a8-44af-b23d-63bb97278ede service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044005 Nov 19 19:28:48.208512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 255/568] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:48.216319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:48.225919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:48.227538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:48.228781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4bb1d82a-0391-4f1d-a91a-cc35e9071279 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1743 microversion: 2.20 time: 0.297354 Nov 19 19:28:48.229472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 314/569] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1743 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:28:48.453146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-2d6125f6-d938-4db0-9eb2-e18038111fca req-182cedc3-a4eb-4564-9b4a-7491a59ee256 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ef8da0-cc9a-484a-b675-ce4bbc67b34d", "name": "network-vif-plugged", "status": "completed", "tag": "a3960fce-279b-4070-adf3-d00c4dc6f1b3"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:48.455210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:48.455210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:28:48.463153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-2d6125f6-d938-4db0-9eb2-e18038111fca req-182cedc3-a4eb-4564-9b4a-7491a59ee256 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.463583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-2d6125f6-d938-4db0-9eb2-e18038111fca req-182cedc3-a4eb-4564-9b4a-7491a59ee256 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.476250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-2d6125f6-d938-4db0-9eb2-e18038111fca req-182cedc3-a4eb-4564-9b4a-7491a59ee256 service nova] Creating event network-vif-plugged:a3960fce-279b-4070-adf3-d00c4dc6f1b3 for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d on hv-cinder-77703 Nov 19 19:28:48.481121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-2d6125f6-d938-4db0-9eb2-e18038111fca req-182cedc3-a4eb-4564-9b4a-7491a59ee256 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032289 Nov 19 19:28:48.482249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 256/570] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:48.497064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:48.498561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:48.509658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.510576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.512077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.512829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.520590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:48.522232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:48.528815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.529387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.531423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.532009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.853088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:48.858377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:48.865819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-97b86cb8-1652-473a-bcb3-41dcc1e43854 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.375700 Nov 19 19:28:48.869124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 315/571] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:48 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:48.872690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17f7101a-aa09-41d5-ba23-b56fdd5cecae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1700 microversion: 2.1 time: 0.356226 Nov 19 19:28:48.873696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 257/572] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1700 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:48.890345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7bf928ff-a19a-40b4-a59b-c86100bbc1f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:48.896514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bf928ff-a19a-40b4-a59b-c86100bbc1f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.896958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bf928ff-a19a-40b4-a59b-c86100bbc1f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.918734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:48.919779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:48.930574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.931233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.932148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:48.932707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:48.959975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7bf928ff-a19a-40b4-a59b-c86100bbc1f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Going to try to start instance {{(pid=116110) start /opt/stack/nova/nova/compute/api.py:2677}} Nov 19 19:28:49.014564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7bf928ff-a19a-40b4-a59b-c86100bbc1f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 202 len: 0 microversion: 2.1 time: 0.127238 Nov 19 19:28:49.016143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 316/573] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:48 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:28:49.024261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:49.025055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:49.033931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.034487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.035369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.036047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.191761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:49.201210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6c9aa740-0d5d-4f9a-b76c-a1f8739a65ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.286741 Nov 19 19:28:49.201812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 258/574] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:49.206785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:49.207390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:49.215868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.216473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.217559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.218122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.404994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:49.421727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-68d80a04-a13f-4d62-ba13-75317a2461e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.402132 Nov 19 19:28:49.422450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 317/575] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:49.432154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:49.433248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:49.444355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.445127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.446554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.447336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.898907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:49.907781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b531909c-ea05-4b25-8774-fa7c072b17e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1709 microversion: 2.1 time: 0.704338 Nov 19 19:28:49.908471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 259/576] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1709 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:49.913217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:49.913831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:49.924377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.925027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:49.925971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:49.926516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.144532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:50.155050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:50.162961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:50.164974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d12bd511-91c6-420c-a7dc-5cd986fcd70f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1743 microversion: 2.20 time: 0.741591 Nov 19 19:28:50.165626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 318/577] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1743 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:50.223485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:50.224257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:50.232051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.232760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.233756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.234521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.279966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:50.288742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af62f1bf-f384-47de-9bd1-5d9dc3587577 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.379201 Nov 19 19:28:50.289339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 260/578] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:49 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:50.443631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:50.443768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:50.444245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:50.452050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ed60ddeb-bfb9-4a15-9d2b-9b250d0d58c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1260 microversion: 2.1 time: 0.232367 Nov 19 19:28:50.453315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.453766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.460391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.460849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.462251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 319/579] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:50.696422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:50.705067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d80bd25-df9e-4d18-b258-babccb2705f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1547 microversion: 2.1 time: 0.269615 Nov 19 19:28:50.705840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 261/580] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1547 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:50.724267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:50.725033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:50.732167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.732959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.734081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.734868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.829658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] HTTP exception thrown: Cannot 'detach_volume' instance 38904995-d04e-4db1-93b4-52153ee2c2e2 while it is in vm_state rescued Nov 19 19:28:50.830457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Returning 409 to user: Cannot 'detach_volume' instance 38904995-d04e-4db1-93b4-52153ee2c2e2 while it is in vm_state rescued {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:28:50.831174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c3ac3dfc-138d-46ba-81c4-cfa2a6118259 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments/0d3888cd-5226-4f80-a3d7-29cb2a2bf2ea" status: 409 len: 152 microversion: 2.1 time: 0.111328 Nov 19 19:28:50.832051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 320/581] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:28:50 2021] DELETE /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments/0d3888cd-5226-4f80-a3d7-29cb2a2bf2ea => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 19 19:28:50.841048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:50.841593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:50.848507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.848937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.849704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.850160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.917798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9fc20da1-aff2-4127-af42-7b62d1f06300 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.080388 Nov 19 19:28:50.918496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 262/582] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:28:50 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:28:50.925808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:50.926549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:50.926854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:50.927599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:50.932884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.933301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.934198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.934627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.935156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.935637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:50.936499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:50.936961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.237022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.245699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.246231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-facb7c27-9159-421b-aa1d-5a60a94a6012 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1709 microversion: 2.1 time: 0.323843 Nov 19 19:28:51.247207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 321/583] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1709 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:51.252488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:51.253441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:51.261341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.261768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.262669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.263085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.267692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39e1110f-560c-443c-b01c-f5f6a8d3eda7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1555 microversion: 2.1 time: 0.344454 Nov 19 19:28:51.268270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 263/584] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1555 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:51.306318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:51.306938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:51.313686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.314183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.315026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.315394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.560435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.572874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.574406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.575612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-960dd153-e2b8-4bfd-8168-ef6a15aee920 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.327222 Nov 19 19:28:51.577191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 322/585] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:51.581938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:51.582564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:51.589223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.589672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.590645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.591062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.672895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.680792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3600c1ec-acb6-4946-8d81-8084b0c17aa3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.378165 Nov 19 19:28:51.681441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 264/586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:51 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:51.847571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:51.856522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-738a7270-164d-4864-8598-34f60cfa8067 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1445 microversion: 2.1 time: 0.277622 Nov 19 19:28:51.857349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 323/587] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1445 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:51.875685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:51.876292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:51.888690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.889400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:51.891646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:51.893134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.056374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:52.065305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-51084d15-699e-4652-b837-e4c03d27a03d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1445 microversion: 2.1 time: 0.193265 Nov 19 19:28:52.083682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 265/588] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1445 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:52.263881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:52.265349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:52.274996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.275457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.276698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.277408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.285754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:52.286355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:52.293400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.293857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.294675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.295111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.522142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:52.525694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:52.531363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56aa0111-930a-4ee0-ba5b-6cbc09d29ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1709 microversion: 2.1 time: 0.271490 Nov 19 19:28:52.541481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f1cdde4b-e053-4ad7-9e88-8f879f473bbb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1555 microversion: 2.1 time: 0.258589 Nov 19 19:28:52.542433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 324/589] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:52 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1709 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:52.554237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 266/590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:52.598368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:52.599613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:52.609911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.610597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.611629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.612125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.700540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:52.701403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:52.714881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.715317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.742350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:52.743194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:52.809722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:52.821495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:52.823907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:52.825909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-af56616a-bb5f-450f-86ef-0f1682df26cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.233463 Nov 19 19:28:52.839313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 325/591] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:53.042762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:53.058971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4a377da-5063-4e62-91d9-dc9f10aa7324 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.362348 Nov 19 19:28:53.066608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 267/592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:52 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:53.549045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:53.549682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:53.579911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:53.579911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:53.579911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.579911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.586203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.586671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.590152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.590779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.594397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.597739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.917960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:53.930131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-172636fc-436b-44bf-b537-342e63f84767 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1555 microversion: 2.1 time: 0.369736 Nov 19 19:28:53.931065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 268/593] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1555 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:53.937985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:53.938911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:53.954632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:53.961224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.964600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56cc7bde-1d4b-445c-a8c5-57772e0b9f4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1709 microversion: 2.1 time: 0.419585 Nov 19 19:28:53.965776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 326/594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1709 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:53.968638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.971273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.971999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5ee6935-ba15-42e5-b2bc-6b483374c0ac", "device": "/dev/sdb"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:53.972863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.974145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:53.982316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.983446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:53.986666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:53.987415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:54.245636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:54.258160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:54.260017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:54.261761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-701ffae6-bee4-4f09-afd5-1ffaadb782e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.329333 Nov 19 19:28:54.273314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 269/595] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:54.273314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:54.273314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:54.274668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:54.275316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:54.276597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:54.277725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:54.491626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:54.504240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0888fa2-27dd-4523-8c13-a37698104ea2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "POST /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.536844 Nov 19 19:28:54.504968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 327/596] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:28:53 2021] POST /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:54.509800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef490eba-f3ac-4008-938b-6c82ca970d13 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.245260 Nov 19 19:28:54.520509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 270/597] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:54 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:54.685472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-5ad9bc10-74b8-4499-9119-96b0ff819475 req-9118fb17-0657-4a50-adae-cdfd05cb584c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1894db7d-c20a-4bcc-8fd3-cf13d214a5ae", "tag": "52339b2d-1214-4a37-8df2-c8f15a213a8a"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:54.687896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:54.687896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:28:54.700631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-5ad9bc10-74b8-4499-9119-96b0ff819475 req-9118fb17-0657-4a50-adae-cdfd05cb584c service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:54.701358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-5ad9bc10-74b8-4499-9119-96b0ff819475 req-9118fb17-0657-4a50-adae-cdfd05cb584c service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:54.717244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-5ad9bc10-74b8-4499-9119-96b0ff819475 req-9118fb17-0657-4a50-adae-cdfd05cb584c service nova] Creating event network-changed:52339b2d-1214-4a37-8df2-c8f15a213a8a for instance 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae on hv-cinder-77703 Nov 19 19:28:54.723262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-5ad9bc10-74b8-4499-9119-96b0ff819475 req-9118fb17-0657-4a50-adae-cdfd05cb584c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042938 Nov 19 19:28:54.726864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 328/598] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:54.957376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:54.959457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:54.972186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:54.973620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:54.975380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:54.976249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:54.984439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:54.985707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:55.002481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:55.006891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:55.008359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:55.009829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:55.361969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:55.376149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9bd44cff-c5ed-443f-ab3a-5e0a9b71f095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1713 microversion: 2.1 time: 0.396563 Nov 19 19:28:55.376742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 329/599] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1713 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:55.392004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:55.392450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:55.398966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:55.401091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:55.403374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:55.405659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:55.453922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:55.467938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-addd028d-3e85-46a2-98f2-222e8fdc9c26 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1555 microversion: 2.1 time: 0.518237 Nov 19 19:28:55.470094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 271/600] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1555 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:55.533205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:55.533880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:55.546404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:55.546887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:55.551434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:55.552191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:55.745054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:55.755711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:55.757486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:55.759372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6771a4b8-b392-4d8b-b51c-3893be92193b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.371222 Nov 19 19:28:55.770937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 330/601] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:55.797775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-630945816", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1911179625", "security_groups": [{"name": "tempest-secgroup-smoke-812189117"}], "block_device_mapping_v2": [{"uuid": "40e6de99-917d-46d4-b668-919050f5ee4f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e467a62c-abc8-485b-8941-f46578a35de7"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:56.373886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:56.382857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae4cd904-55b1-4a0c-8e44-44453faf21f5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.858927 Nov 19 19:28:56.384029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 272/602] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:55 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:56.389517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-8dbbcc72-ae23-4b8a-a8e8-48ff61949999 req-375acb4f-b45c-412c-b04a-6a2d004c59c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44827b1f-caee-49a9-a965-3b186454972f", "name": "network-vif-plugged", "status": "completed", "tag": "1d493c07-2d7d-41c0-9104-2f6c85143734"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:28:56.391480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:28:56.391480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:28:56.399974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] validate_networks() for [('e467a62c-abc8-485b-8941-f46578a35de7', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:28:56.402655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-8dbbcc72-ae23-4b8a-a8e8-48ff61949999 req-375acb4f-b45c-412c-b04a-6a2d004c59c9 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:56.403272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-8dbbcc72-ae23-4b8a-a8e8-48ff61949999 req-375acb4f-b45c-412c-b04a-6a2d004c59c9 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:56.417202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-8dbbcc72-ae23-4b8a-a8e8-48ff61949999 req-375acb4f-b45c-412c-b04a-6a2d004c59c9 service nova] Creating event network-vif-plugged:1d493c07-2d7d-41c0-9104-2f6c85143734 for instance 44827b1f-caee-49a9-a965-3b186454972f on hv-cinder-77703 Nov 19 19:28:56.424816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-8dbbcc72-ae23-4b8a-a8e8-48ff61949999 req-375acb4f-b45c-412c-b04a-6a2d004c59c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039135 Nov 19 19:28:56.426088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 273/603] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:28:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:56.488397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:56.493416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:56.506143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:56.507010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:56.508047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:56.508695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:56.996981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:57.008342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c950514-432f-4dee-bca8-b2e711d3f4de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1555 microversion: 2.1 time: 0.523936 Nov 19 19:28:57.010323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 274/604] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1555 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:57.018299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:57.019163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:57.029984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:57.030843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:57.031888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:57.032546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:57.257917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:28:57.258510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:28:57.258886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:28:57.259460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:28:57.259871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:28:57.277713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:57.278556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:57.279758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:57.280270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:57.299955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Getting quotas for project 62170a929e0f4fb5aad1a629f86de1f4. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:28:57.304881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Getting quotas for user 4cceacd1aa1e47a5bf03e02d2cf64fc3 and project 62170a929e0f4fb5aad1a629f86de1f4. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:28:57.305050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:57.315200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:57.316803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:57.318082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0e631bd-30c3-4e34-870c-6b50542a6e93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.306355 Nov 19 19:28:57.318745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 275/605] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:57.378220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:28:57.381231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40e6de99-917d-46d4-b668-919050f5ee4f',volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:28:57.400746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:57.401343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:57.407690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:57.408125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:57.409728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:57.409728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:57.563729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b5fcc4e6-5483-459c-9e50-681de41ae07e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.769852 Nov 19 19:28:57.569700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 331/606] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:28:55 2021] POST /compute/v2.1/servers => generated 405 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 19 19:28:57.574469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2d96806e-4d6d-4b0a-9ced-f10d118381d8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:57.575374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2d96806e-4d6d-4b0a-9ced-f10d118381d8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:57.668510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2d96806e-4d6d-4b0a-9ced-f10d118381d8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:57.672552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:57.680466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4fc6c842-71f5-4fa8-9612-a7f781fdc8b9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.283746 Nov 19 19:28:57.680829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2d96806e-4d6d-4b0a-9ced-f10d118381d8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1094 microversion: 2.1 time: 0.109857 Nov 19 19:28:57.681347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 332/607] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1094 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:57.691008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 276/608] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:57 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:58.038415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:58.039644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:58.059478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.060375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.063717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.064368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.252760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:58.273579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9cb23319-1734-4f5f-bf51-84de7ef964c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1561 microversion: 2.1 time: 0.238987 Nov 19 19:28:58.275767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 333/609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1561 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:58.339654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:58.340987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:58.364897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.365998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.367990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.368983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.385788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:58.386581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:58.404187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.406146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.407512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.416337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.556967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lazy-loading 'services' on Instance uuid 38904995-d04e-4db1-93b4-52153ee2c2e2 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:28:58.647411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:58.660992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f7607c6c-513a-47d6-a61a-f441c0c1a08c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments/0d3888cd-5226-4f80-a3d7-29cb2a2bf2ea" status: 202 len: 0 microversion: 2.1 time: 0.287366 Nov 19 19:28:58.663762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:58.667271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:58.669954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9137b2fe-3732-4d16-bb8d-7927eac64dfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.336497 Nov 19 19:28:58.671497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 277/611] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:28:58.679169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:58.681628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:58.686176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 334/611] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:28:58 2021] DELETE /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments/0d3888cd-5226-4f80-a3d7-29cb2a2bf2ea => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:28:58.694752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.695655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.696998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.697844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.701464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:58.705161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:58.716184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.718140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.719326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.720687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.754562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-783579c2-e159-44f2-9f98-210bb7db77de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081079 Nov 19 19:28:58.761829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 278/612] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:58.772696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:58.773396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:58.781404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.782415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.783365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:58.783809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:58.840573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:58.853459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e347f7d-4555-4270-a08e-d6a0b5674f0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1192 microversion: 2.1 time: 0.156241 Nov 19 19:28:58.853459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 335/613] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1192 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:59.026151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:59.044198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7bc2ab9e-cb27-432f-a735-85b7ebfb2dd0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.277514 Nov 19 19:28:59.044852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 279/614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:58 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:28:59.688883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:59.689508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:59.696249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:59.696702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:59.697580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:59.698028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:59.773488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:59.774740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:59.785314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:59.785770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:59.786596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:59.787027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:59.824251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-51115cae-1345-46ae-83c9-0fac908eaecc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054630 Nov 19 19:28:59.828417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 280/615] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:28:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:28:59.870365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:28:59.871109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:28:59.877614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:59.878167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:59.879015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:28:59.879510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:28:59.961301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:59.970157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3b058ffd-aedf-4607-a132-72a561da5e1c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1210 microversion: 2.1 time: 0.103359 Nov 19 19:28:59.971492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 281/616] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:28:59 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:28:59.982562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:59.992085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:59.993611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:28:59.995052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9394d1a0-c7a7-4808-a42c-55af0b033595 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.309975 Nov 19 19:28:59.995784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 336/617] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:28:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:00.066555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:00.068272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:00.074847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:00.075433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:00.077912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:00.078504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:00.336786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:00.362628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6675247f-cbc6-4dd9-941c-7d36e2e64122 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1318 microversion: 2.1 time: 0.301763 Nov 19 19:29:00.373945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 282/618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:00 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1318 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:00.836442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:00.838455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:00.849141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:00.852705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:00.854006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:00.855770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:00.890563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-139c89aa-79d5-458f-b8fb-b820cf23525d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058066 Nov 19 19:29:00.891609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 337/619] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:00.987738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:00.988375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:00.994928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:00.995600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:00.996671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:00.997267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.015383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:01.017549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:01.034939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.035413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.036294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.036806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.371706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:01.381381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8c29c4eb-9fb9-4772-bc75-196349aa60f9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.397230 Nov 19 19:29:01.382156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 283/620] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:00 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:01.387820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:01.389120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:01.396887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.397607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.397979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:01.398946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.399567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.421682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:01.423970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:01.425282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9ea44d9-a0eb-445a-b2fa-d74f760a29f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.415075 Nov 19 19:29:01.426468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 338/621] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:01.652346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:01.666921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4576afe-cdd4-4542-bd29-a19f21b49ae3 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1507 microversion: 2.1 time: 0.283288 Nov 19 19:29:01.683236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 284/622] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:01 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:01.751738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-abb96659-29d3-48e6-94cb-a5125aff4a0f req-04b2605d-e7a0-4af4-a4e2-74fde44c886b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54959e8f-aff5-49c3-a76e-a89d678c18a4", "tag": "e44d6bf4-f226-405c-8f2e-d6cf27150e97"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:29:01.753573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:29:01.753573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:29:01.767278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-abb96659-29d3-48e6-94cb-a5125aff4a0f req-04b2605d-e7a0-4af4-a4e2-74fde44c886b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.767726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-abb96659-29d3-48e6-94cb-a5125aff4a0f req-04b2605d-e7a0-4af4-a4e2-74fde44c886b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.794284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-abb96659-29d3-48e6-94cb-a5125aff4a0f req-04b2605d-e7a0-4af4-a4e2-74fde44c886b service nova] Creating event network-changed:e44d6bf4-f226-405c-8f2e-d6cf27150e97 for instance 54959e8f-aff5-49c3-a76e-a89d678c18a4 on hv-cinder-77703 Nov 19 19:29:01.803685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-abb96659-29d3-48e6-94cb-a5125aff4a0f req-04b2605d-e7a0-4af4-a4e2-74fde44c886b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061919 Nov 19 19:29:01.816009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 339/623] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:29:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:01.908283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:01.909294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:01.921796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.925436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:01.926665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:01.927137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:02.039637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-418eb78a-e28c-44fe-954f-3d418bda478a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136302 Nov 19 19:29:02.041257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 285/624] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:02.399472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:02.400324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:02.414146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:02.414603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:02.415563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:02.415987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:02.443680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:02.444620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:02.473053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:02.473793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:02.474794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:02.475396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:02.730729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:02.734436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:02.743756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-91d7b1f9-5fb4-466b-a0bc-1302bdef949f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.348683 Nov 19 19:29:02.744939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 340/625] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:02 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:02.754734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:02.756765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:02.762481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b7475084-9893-4a39-88dd-f893321eacb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.322484 Nov 19 19:29:02.763941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 286/626] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:03.051813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:03.052731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:03.063422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.063921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.068357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.068805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.119335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ebebe15d-337c-448d-9908-d8c95f43d6f0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071121 Nov 19 19:29:03.123457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 341/627] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:03.264587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a633dc4-e664-4ff2-92ad-f459f271087c"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:29:03.266426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:03.274956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.275661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.276802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.277660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.653075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ade8aa12-48b7-4389-90e9-78f1bad89ec5 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.392740 Nov 19 19:29:03.654011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 287/628] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 19:29:03 2021] POST /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:03.763115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:03.765122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:03.771416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.781210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:03.781917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:03.785453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.786349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.786805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.789012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.789547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:03.790424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:03.791570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:04.074981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:04.089117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fcdb4a28-ef32-42dd-a7ad-691c22439ac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.329633 Nov 19 19:29:04.093914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 342/629] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:04.128956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:04.133506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:04.135671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:04.140264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:04.144153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:04.145706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d6fc3340-653b-4a98-9702-0555ccc9d9a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.368693 Nov 19 19:29:04.146924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 288/630] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:29:04.149757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:04.150520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:04.151733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:04.152381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:04.188628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1fd37200-d462-4d35-a9d9-dd8a9ce072fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061057 Nov 19 19:29:04.189862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 343/631] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:05.111210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:05.112086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:05.119604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:05.120272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:05.121330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:05.121741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:05.185071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:05.186904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:05.197942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:05.198591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:05.199940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:05.200696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:05.377150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:05.384825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7cc78bac-398a-42b4-a590-48886815c6c2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.278057 Nov 19 19:29:05.385404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 289/632] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:05 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:05.390106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:05.391294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:05.398237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:05.398951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:05.401007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:05.401683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:05.444860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d879776f-2712-4f87-983c-573120aea543 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058406 Nov 19 19:29:05.445949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 290/633] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:05.680891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:05.689589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:05.691117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:05.692282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5f099f6-8e39-42ab-a724-960b660f7428 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1738 microversion: 2.20 time: 0.529831 Nov 19 19:29:05.692863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 344/634] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1738 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:06.403204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:06.403924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:06.411374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:06.411831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:06.412620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:06.413019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:06.455716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:06.456644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:06.463068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:06.463541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:06.464323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:06.464752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:06.497109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7ebf05f-2ce1-4a40-bb00-8bd7834b7ca7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Nov 19 19:29:06.498131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 345/635] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:06.562611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:06.570318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01e4b90e-e5eb-47f4-816f-dcd3164e7948 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171663 Nov 19 19:29:06.570978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 291/636] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:06.710712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:06.711314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:06.718237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:06.718676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:06.719494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:06.719927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:06.922323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:06.930710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:06.932194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:06.933361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ad8efd2-6ddd-4419-9276-f60d53a09283 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1720 microversion: 2.20 time: 0.226426 Nov 19 19:29:06.933928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 346/637] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:07.508868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:07.509826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:07.517202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:07.517841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:07.518465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:07.518893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:07.552219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1aaa5f60-f866-4eda-bd45-3db739a1fc11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047051 Nov 19 19:29:07.552793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 292/638] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:07.587563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:07.588157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:07.594887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:07.595704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:07.596484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:07.596926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:07.747099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:07.754923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ba27f55d-8124-45b3-afa6-1f86ddc546ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171030 Nov 19 19:29:07.755509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 347/639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:07.952978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:07.953571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:07.960377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:07.960817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:07.961588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:07.962018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:08.111608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:08.119441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:08.120903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:08.122064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa11e8b2-e893-4e79-ab58-9b4c7c85a239 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1720 microversion: 2.20 time: 0.173009 Nov 19 19:29:08.122914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 293/640] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:08.563604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:08.564561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:08.571395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:08.571817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:08.572631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:08.573055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:08.606886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1611fe0b-a430-4092-944b-cae3dd57f074 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047180 Nov 19 19:29:08.608307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 348/641] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:08.772528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:08.773193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:08.780273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:08.780728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:08.781492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:08.781947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:08.922909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:08.930908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19f64ef5-ac74-4943-b108-8060b79cd298 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162071 Nov 19 19:29:08.931449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 294/642] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:09.140715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:09.141328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:09.147805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:09.148258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:09.149038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:09.149481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:09.282599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:09.290897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:09.292360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:09.293513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-938e98d6-928d-4f82-816f-c2cb235a9ce9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1720 microversion: 2.20 time: 0.156650 Nov 19 19:29:09.294102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 349/643] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:09.619935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:09.620746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:09.627766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:09.628207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:09.628999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:09.629418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:09.661740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4838e45-36f0-4760-974f-c4d62d2b1e49 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045641 Nov 19 19:29:09.662331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 295/644] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:09.948019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:09.948647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:09.955322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:09.955787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:09.956583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:09.957028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:10.024081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-09b8436a-0ce1-451b-8bdb-24790b75ffa5 req-ee47ea6d-2124-4845-a28a-52e4d4fa3a25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ef8da0-cc9a-484a-b675-ce4bbc67b34d", "name": "network-vif-unplugged", "status": "completed", "tag": "a3960fce-279b-4070-adf3-d00c4dc6f1b3"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:29:10.026445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:29:10.026445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:29:10.038391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-09b8436a-0ce1-451b-8bdb-24790b75ffa5 req-ee47ea6d-2124-4845-a28a-52e4d4fa3a25 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:10.039042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-09b8436a-0ce1-451b-8bdb-24790b75ffa5 req-ee47ea6d-2124-4845-a28a-52e4d4fa3a25 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:10.052032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-09b8436a-0ce1-451b-8bdb-24790b75ffa5 req-ee47ea6d-2124-4845-a28a-52e4d4fa3a25 service nova] Creating event network-vif-unplugged:a3960fce-279b-4070-adf3-d00c4dc6f1b3 for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d on hv-cinder-77703 Nov 19 19:29:10.057019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-09b8436a-0ce1-451b-8bdb-24790b75ffa5 req-ee47ea6d-2124-4845-a28a-52e4d4fa3a25 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037917 Nov 19 19:29:10.066758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 296/645] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:29:10 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:10.105265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:10.112935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-337f376b-593f-4a0c-86df-316aa2e58547 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168600 Nov 19 19:29:10.113498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 350/646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:10.312577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:10.313261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:10.319969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:10.320411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:10.321181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:10.321603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:10.459293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:10.468481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:10.469967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:10.471514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-360e5e26-b708-46f0-b0ee-a24410e2fc25 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1720 microversion: 2.20 time: 0.163209 Nov 19 19:29:10.472040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 297/647] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:10.673868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:10.674964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:10.681978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:10.682480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:10.683287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:10.683730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:10.715845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1834eed-7bca-4017-87fe-eed0cbaa9f1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Nov 19 19:29:10.720770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 351/648] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:11.130929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:11.131552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:11.140334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.140782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.141577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.142031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.289169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:11.297145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-732e7a6c-5eaf-4e69-8431-a5c9f84a4d89 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169890 Nov 19 19:29:11.297716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 298/649] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:11 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:11.489406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:11.490012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:11.496916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.497631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.498662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.499244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.639944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:11.647802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:11.649264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:11.650453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-795a1bde-c09d-4bd5-aaf3-7ecbc11e567c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1663 microversion: 2.20 time: 0.164804 Nov 19 19:29:11.650989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 352/650] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1663 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:11.668553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "554d5fcb-ed47-49f6-a71b-c1a210a5fa8c"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:29:11.669621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:11.675800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.676279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.677129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.677561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.728693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:11.729618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:11.736605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.737078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.737877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:11.738342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:11.771532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-17006557-017c-4268-9d41-e74a6b918f00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046841 Nov 19 19:29:11.772394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 353/651] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:11.979031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-34bff034-2f80-4258-a5a4-bfab1541def2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314215 Nov 19 19:29:11.980022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 299/652] 10.222.0.46 () {62 vars in 1363 bytes} [Fri Nov 19 19:29:11 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:29:12.094620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:29:12.095545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:12.101741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.102215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.102984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.103408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.200352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f58a394-2b1c-42aa-afc2-497afd55b36f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 202 len: 0 microversion: 2.20 time: 0.109382 Nov 19 19:29:12.201805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 354/653] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:29:12 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:29:12.209438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:12.210088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:12.217434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.217878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.218697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.219164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.314470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:12.315732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:12.322373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.322820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.323600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.324024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.379870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:12.388950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:12.390595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:12.391887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b1bc0a7c-ebaa-44d5-ab10-0c7b9e107629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1749 microversion: 2.20 time: 0.186254 Nov 19 19:29:12.392461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 300/654] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1749 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:12.473968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:12.481411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-347af3ae-fe9d-4363-ba55-3cbb415df84a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.170952 Nov 19 19:29:12.481992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 355/655] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:12 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:12.783517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:12.784544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:12.790722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.791174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.791959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:12.792390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:12.824544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fdaad2c5-9ac6-4ba5-81f1-a0be3354ec98 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Nov 19 19:29:12.825132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 301/656] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:13.413675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:13.414356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:13.421200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:13.421656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:13.422488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:13.422927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:13.500304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:13.500946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:13.508312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:13.508763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:13.509612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:13.510080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:13.603736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:13.613999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:13.615754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:13.617218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71d82443-2747-4c09-8a13-493acf9ac4aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.207295 Nov 19 19:29:13.617853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 356/657] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:13.687604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:13.695870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a7c0c1e-1548-4919-9520-397ed5d08304 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.200377 Nov 19 19:29:13.696466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 302/658] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:13 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:13.836064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:13.836904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:13.843680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:13.844132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:13.844960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:13.845758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:13.877120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d18a8d3c-7086-4c80-9ca6-db079ee9e750 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Nov 19 19:29:13.877701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 357/659] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:14.637811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:14.638618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:14.646077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:14.646679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:14.647509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:14.647969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:14.714379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:14.715387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:14.724187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:14.724776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:14.725834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:14.726588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:14.832871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:14.842647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:14.844436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:14.846667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f67527b4-25ae-46a8-9d92-4888dc82ddfe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.212975 Nov 19 19:29:14.847550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 303/660] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:14.888577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:14.889628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:14.899125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:14.900353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:14.901806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:14.902783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:14.911745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:14.920100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f0dbee33-e674-422f-8731-555d76387102 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.209719 Nov 19 19:29:14.920971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 358/661] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:14.947387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0fd5bf7d-893d-42d2-8a79-593799b3fe38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062811 Nov 19 19:29:14.948491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 304/662] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:15.875888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:15.876939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:15.884625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:15.885215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:15.886154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:15.886675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:15.949538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:15.951038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:15.964869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:15.965656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:15.968220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:15.968985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:16.083629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:16.094924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:16.096944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:16.098698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bc18dba2-6b6b-4c75-88f7-cde1dc0f25eb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.226583 Nov 19 19:29:16.099713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 359/663] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:16.108489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:16.110149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:16.119638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:16.120137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:16.120966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:16.121441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:16.176247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-892eeab5-6284-49dc-a953-eb8ab33cd41d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074774 Nov 19 19:29:16.177271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 360/664] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:16.198543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:16.207520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-09e5cbae-69b5-46bd-afe6-7ba92d4d7a74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.265566 Nov 19 19:29:16.208280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 305/665] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:15 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:17.117720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:17.118377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:17.125811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:17.126535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:17.127204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:17.127599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:17.189130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:17.190075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:17.197576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:17.198021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:17.198848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:17.199282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:17.233899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f23d08ba-8234-4a64-843c-bed5f4613c33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048440 Nov 19 19:29:17.234509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 306/666] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:17.239062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:17.239679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:17.246456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:17.246770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:17.247654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:17.249642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:17.339512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:17.349803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:17.351908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:17.353164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bebf7815-d33b-4653-b147-fb59d610fcb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.239419 Nov 19 19:29:17.365803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 361/667] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:17.433659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:17.448478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-97dc31be-6b0b-4af9-845b-1399aca7b3a0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.212558 Nov 19 19:29:17.449422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 307/668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:17 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:18.246286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:18.249068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:18.257049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:18.257499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:18.258328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:18.258762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:18.292113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5aeac1f6-f428-4b13-bc13-0ef22ac40833 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049580 Nov 19 19:29:18.292732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 362/669] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:18.383158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:18.383774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:18.391272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:18.391615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:18.392413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:18.392836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:18.469826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:18.469826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:18.478925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:18.479760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:18.480522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:18.480937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:18.573862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:18.582981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:18.584486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:18.585600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d37f544-0f4e-4a03-83b2-148a9ca74c18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.206348 Nov 19 19:29:18.586332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 308/670] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:18.644909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:18.652743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e8d9add-dd5c-4a8a-9557-0be533b97fb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.188628 Nov 19 19:29:18.653333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 363/671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:19.304522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:19.305432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:19.312206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:19.312657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:19.313498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:19.313931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:19.344704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e963f136-18c8-420f-a2a2-ddee4a36d2f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Nov 19 19:29:19.345643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 309/672] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:19.605128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:19.605856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:19.612695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:19.613141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:19.613927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:19.614375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:19.670618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:19.671356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:19.678168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:19.678655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:19.679446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:19.679881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:19.804594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:19.814209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:19.815965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:19.817212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d1b44b1-d99d-420d-8a35-ff0744b5c36d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.215787 Nov 19 19:29:19.817793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 364/673] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:19.856215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:19.865662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae81947c-caac-4633-93e6-f8a26a7544af tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.199143 Nov 19 19:29:19.866292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 310/674] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:19 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:20.357008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:20.358532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:20.364991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:20.365440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:20.366253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:20.366689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:20.397880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8fc00f2e-fbad-4336-b293-83509601f105 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Nov 19 19:29:20.398520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 365/675] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:20.836384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:20.837039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:20.844612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:20.844958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:20.846179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:20.846610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:20.883848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:20.884477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:20.891891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:20.892315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:20.893395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:20.893839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:21.031678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:21.040897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:21.042544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:21.043859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2715a05d-367f-4e54-85f1-89d730bd31b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.211272 Nov 19 19:29:21.044386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 311/676] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:21.077919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:21.085850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef3c1394-75a6-4564-bfbf-895f7752d5d4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.205938 Nov 19 19:29:21.086472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 366/677] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:21.409889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:21.410869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:21.417396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:21.417845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:21.418669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:21.419098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:21.449462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3b359f7b-d0c0-4a2e-ba8a-e94c387ff466 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043278 Nov 19 19:29:21.450008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 312/678] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:22.062616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:22.063250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:22.069902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:22.070377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:22.071159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:22.071583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:22.103471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:22.104188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:22.111243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:22.111695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:22.112482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:22.112912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:22.252612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:22.261863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:22.263424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:22.264618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6da5f5dd-2cc4-4532-803a-3826c70c8be2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.205865 Nov 19 19:29:22.265197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 367/679] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:22.292972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:22.300908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2b82e321-ca6d-4866-8ffd-ba351f550725 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.201070 Nov 19 19:29:22.301473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 313/680] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:22 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:22.461072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:22.461992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:22.468641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:22.469096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:22.469873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:22.470714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:22.501230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-45f2c813-dfd3-4c3c-b6f1-74b268d8db22 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Nov 19 19:29:22.501799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 368/681] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:23.283645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:23.284285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:23.291633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:23.292084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:23.292889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:23.293326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:23.318160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:23.318799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:23.326008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:23.326590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:23.327409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:23.327872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:23.507070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:23.516462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:23.517931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:23.519143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa979165-e090-4710-983a-cf3b5fd7baa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.239522 Nov 19 19:29:23.519700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 314/682] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:23.521413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:23.524398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:23.525314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:23.530705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ffabf8f9-362b-4e5c-8360-574863a2769b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.216234 Nov 19 19:29:23.531451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 369/683] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:23.531749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:23.532276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:23.533220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:23.533670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:23.565017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5ee7cd0-9444-49d2-b9ec-a9932835ddeb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044234 Nov 19 19:29:23.565587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 315/684] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:24.538722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:24.539335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:24.546742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:24.547216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:24.548048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:24.548483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:24.548910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:24.549669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:24.556596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:24.557035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:24.557815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:24.558282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:24.848545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:24.864815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:24.866576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:24.867897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8b2f4a6-726a-4810-9ab7-a651dd52051c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.334887 Nov 19 19:29:24.868596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 370/685] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:24.875303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:24.876854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:24.878563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:24.884962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cda3d303-8f49-48d2-a077-0238b80beb13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.340738 Nov 19 19:29:24.886410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 316/686] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:24 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:24.888953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:24.889580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:24.890550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:24.891050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:24.922615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6e8f3572-d596-4df1-9260-39d5d5e03340 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052524 Nov 19 19:29:24.923191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 371/687] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:25.896068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:25.896868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:25.905571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:25.906480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:25.907864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:25.908215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:25.908841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:25.909834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:25.917270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:25.917853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:25.918782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:25.919396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:26.127732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:26.139129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:26.140620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:26.141854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:26.143802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5318d062-d913-49ea-95c3-6e6b92d7c26e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.251724 Nov 19 19:29:26.144732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 317/688] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:26.152954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:26.153240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-95acdbe1-3e0c-46bc-8740-5b069dc9eb35 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.250592 Nov 19 19:29:26.154417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 372/689] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:25 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:26.154636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:26.161864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:26.162493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:26.163380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:26.163911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:26.197211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d232d1a1-6ca9-4d68-85c3-527ed4d67b17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051068 Nov 19 19:29:26.197775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 318/690] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:27.166525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:27.167462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:27.174972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:27.175442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:27.176230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:27.176670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:27.177737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:27.178940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:27.190079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:27.190883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:27.192245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:27.192991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:27.525000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:27.535196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:27.536856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:27.538196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1d65573c-4cd1-4aed-8c6c-2fdea0ecf28c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.375568 Nov 19 19:29:27.538793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 373/691] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:27.543751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:27.544681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:27.546338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:27.551836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:27.552825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:27.553945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:27.554482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:27.561354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-08d2523b-44dd-44bf-94ab-0a1a196e2d76 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.391203 Nov 19 19:29:27.561960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 319/692] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:27 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:27.591094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ccd5f48-ff9f-4af7-be79-95e8d8750e10 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051121 Nov 19 19:29:27.591842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 374/693] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:28.565597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:28.566237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:28.572612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:28.573082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:28.573870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:28.574324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:28.586005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:28.586939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:28.594606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:28.595447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:28.596685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:28.597446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:28.883808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:28.893643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:28.895256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:28.896518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f21a7521-ecce-4406-9907-7b3913fd0c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.335299 Nov 19 19:29:28.897090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 320/694] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:28.901723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:28.902666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:28.915863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:28.916311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:28.917109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:28.917536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:28.928737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:28.937480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ef011b3-917a-458c-86c1-bdd55e78dd80 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.355171 Nov 19 19:29:28.938387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 375/695] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:28 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:28.950039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-442ec753-37d1-4948-8a72-1e82c51690dc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051844 Nov 19 19:29:28.950637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 321/696] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:29.915212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:29.916043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:29.923575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:29.924023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:29.924814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:29.925248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:29.963530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:29.964414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:29.972395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:29.972845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:29.973636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:29.974105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:30.278022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:30.288430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:30.289938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:30.291215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85aeee6d-d2c8-428a-86de-5f8ff7a98e4b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.379727 Nov 19 19:29:30.291811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 376/697] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:30.294566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:30.296941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:30.297884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:30.304445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:30.304898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:30.305834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:30.306287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:30.310617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-69365226-b161-48cd-9a22-ecf02ad3e2cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.350405 Nov 19 19:29:30.311680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 322/698] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:30.344035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a757652b-b126-431e-b83d-e5a238dc7626 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051083 Nov 19 19:29:30.344649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 377/699] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:31.320710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:31.324109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:31.329964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:31.331054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:31.331522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:31.332531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:31.333276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:31.333950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:31.345534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:31.346279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:31.347530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:31.348215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:31.670406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:31.682243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:31.684759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:31.686729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-868d21c7-bde0-4ffa-a2f8-df2f63600f55 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.369743 Nov 19 19:29:31.687456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 323/700] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:31.693700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:31.694938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:31.697090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:31.707284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-634d0996-5261-41e5-b060-1da0c8b6bac2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.381497 Nov 19 19:29:31.708287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 378/701] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:31.708874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:31.709635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:31.711101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:31.711844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:31.755935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe99cec6-41f2-4ed2-a138-0648ebfa0e48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066904 Nov 19 19:29:31.756948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 324/702] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:32.713604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:32.714237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:32.722291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:32.722800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:32.723791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:32.724270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:32.733649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:32.734704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:32.742280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:32.743015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:32.744348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:32.745037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:33.023664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:33.038952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:33.041424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:33.043704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8257fab2-6085-4378-b9ae-76248a9ad3b7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.334022 Nov 19 19:29:33.045077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 379/703] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:33.053126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:33.054827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:33.063108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:33.064469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:33.064978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:33.065852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:33.066376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:33.073901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-deb48349-c141-4128-9e5d-696fcfce077a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.345251 Nov 19 19:29:33.075450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 325/704] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:32 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:33.108400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2abce8c2-8b1b-4aa0-b9e3-9da7ca566723 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061991 Nov 19 19:29:33.109792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 380/705] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:34.067362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:34.068075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:34.075206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:34.075638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:34.076584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:34.077023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:34.093802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:34.094711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:34.103108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:34.103695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:34.104872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:34.105511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:34.304120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:34.310212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:34.318139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:34.320846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:34.322413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0f1ddabc-8d4f-4459-b5dc-34186347cfd7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.232759 Nov 19 19:29:34.322849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cfba60af-4185-4e05-b016-948a59122a4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.259126 Nov 19 19:29:34.323376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 381/706] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:34 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:34.323760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 326/707] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:34.330592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:34.331836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:34.338836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:34.339449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:34.340382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:34.340912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:34.385648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-865062c2-ed77-4739-8441-d7f2a08b0cf6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060435 Nov 19 19:29:34.387809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 382/708] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:35.348957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:35.349561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:35.352270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:35.353396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:35.357618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:35.359004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:35.359191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:35.359787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:35.365343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:35.366183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:35.367520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:35.368263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:35.593880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:35.600322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:35.603097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd6d7102-0034-4459-98b7-d9ed3017475a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.258589 Nov 19 19:29:35.603700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 327/709] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:35 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:35.608860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:35.609804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:35.616324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:35.616659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:35.616852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:35.617562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:35.617995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:35.619835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:35.622238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7d15bc7-23d9-4012-bbf1-6c11edef09bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.276655 Nov 19 19:29:35.624260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 383/710] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:35.652487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17777f28-2ec0-4e95-b731-94c9912d8d79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047639 Nov 19 19:29:35.653096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 328/711] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:36.622861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:36.623600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:36.630780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:36.631269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:36.632051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:36.632512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:36.655536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:36.656593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:36.668555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:36.669543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:36.671259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:36.671906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:36.984076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:36.994285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:36.994581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1519c534-428b-417b-b545-1d9f16fc7a8f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.375196 Nov 19 19:29:36.995421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 384/712] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:36 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:37.004975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:37.005891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:37.007050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:37.007690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:37.009151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43b570a9-0d24-4e34-8f28-f4bee174f437 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.359917 Nov 19 19:29:37.009840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 329/713] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:37.023118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:37.023651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:37.024542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:37.025021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:37.056497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5ef7d680-a4e5-49c8-bc2a-7d15c943fb17 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059453 Nov 19 19:29:37.057109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 385/714] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:38.020360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:38.021257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:38.029213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:38.029665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:38.030549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:38.030988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:38.033108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:38.034233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:38.045149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:38.045935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:38.047307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:38.048120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:38.232484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:38.241891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-21389832-7569-4b78-b98d-4c61286c690c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.226204 Nov 19 19:29:38.243108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 330/715] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:38.254601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:38.254601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:38.261895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:38.262439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:38.263515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:38.264116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:38.311115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:38.312606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1b32eaf8-7581-4ea3-9a95-ced3a46e172c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067291 Nov 19 19:29:38.313533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 331/716] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:38.319708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:38.321197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:38.322412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9dfb6497-caa2-4bec-9d8d-dddaaeb30dc8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.296559 Nov 19 19:29:38.322982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 386/717] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:29:39.260698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:39.261637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:39.273847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:39.273847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:39.274869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:39.275610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:39.341506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:39.343268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:39.354547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:39.355192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:39.356185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:39.356753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:39.400740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0887e55d-2cdd-4d03-9237-c37f7897b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076082 Nov 19 19:29:39.401810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 387/718] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:39.410715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:39.411973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:39.423958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:39.424809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:39.426435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:39.427253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:39.668113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:39.679009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-03e206e4-d93a-4bc5-9227-88d9fe0fd531 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.422161 Nov 19 19:29:39.679763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 332/719] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:39 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:39.749257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:39.765828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:39.769298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:39.771681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-36d1b99f-880b-4ff4-b390-0b63e17c618f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.367997 Nov 19 19:29:39.772674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 388/720] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:40.413680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:40.414647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:40.421847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:40.422317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:40.423109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:40.423543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:40.456263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8321281-6a7c-4e85-a176-1f02c66f095f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046926 Nov 19 19:29:40.456836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 333/721] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:40.697576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:40.698215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:40.706538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:40.707017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:40.708207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:40.708971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:40.801389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:40.802993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:40.815471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:40.816402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:40.817537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:40.818193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:40.894382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:40.907327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e6dd183-acf3-4d2b-b813-90b0d1dd3926 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.213439 Nov 19 19:29:40.908276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 389/722] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:40.999438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:41.008866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:41.010507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:41.011695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e13d141-2898-4f62-aac3-0d557b5ff2bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.217799 Nov 19 19:29:41.012271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 334/723] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:29:41.468148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:41.469249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:41.476074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:41.476652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:41.477534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:41.477999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:41.508204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e391ccbb-dacc-40d7-8ea9-08f8bd799c3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Nov 19 19:29:41.508740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 390/724] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:41.932950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:41.933614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:41.940558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:41.940999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:41.941773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:41.942231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:42.035547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:42.036638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:42.048989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:42.049774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:42.051168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:42.051931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:42.114615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:42.123994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4c6d3bfc-d3f3-4d89-a9c2-98a10bc3f735 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.194292 Nov 19 19:29:42.124662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 335/725] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:41 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:42.211154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:42.228382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:42.231120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:42.233289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b2d1a51-ec4d-488d-ad52-5f873acb4d45 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.205763 Nov 19 19:29:42.234331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 391/726] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:29:42.521556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:42.522511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:42.529801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:42.530289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:42.531083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:42.531516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:42.565980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d530b8a-c1d7-4d13-a333-9acbf617dbb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048172 Nov 19 19:29:42.566608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 336/727] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:43.148703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:43.149349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:43.156209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:43.156664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:43.157439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:43.157896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:43.261189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:43.261930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:43.270171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:43.270880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:43.272209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:43.272911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:43.313598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:43.321434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0b764f32-b3ae-4c56-9696-e0ecafce5f9b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.176441 Nov 19 19:29:43.322026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 392/728] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:43 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:43.442709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:43.452680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:43.454244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:43.455438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0eba045d-913d-4cbf-9516-b85e063b1189 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.199826 Nov 19 19:29:43.455998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 337/729] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:43.580201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:43.581318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:43.588775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:43.589203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:43.590018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:43.590504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:43.625525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79f8fe84-0f0b-47a7-82ef-64da98b7f56b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050676 Nov 19 19:29:43.626352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 393/730] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:44.338942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:44.339581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:44.347278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:44.347728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:44.348518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:44.348948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:44.473927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:44.474947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:44.485084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:44.485841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:44.487243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:44.488009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:44.510304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:44.523591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4cbf7c3-abab-4670-aeed-bafff639162c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.187950 Nov 19 19:29:44.524647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 338/731] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:44 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:44.646723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:44.646933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:44.646933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:44.647255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:44.647423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:44.648214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:44.648654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:44.657130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:44.660012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:44.662098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11997acc-a1a0-4349-bf1c-16d7d624419e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.192101 Nov 19 19:29:44.663124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 394/732] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:44.683862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba06440b-3c71-407e-a41a-549db0a299a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 Nov 19 19:29:44.684444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 339/733] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:45.550451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:45.551089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:45.559979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:45.560647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:45.561658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:45.562122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:45.695111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:45.696086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:45.706373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:45.707489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:45.708968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:45.709865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:45.728204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:45.741590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b8c17ed-1d05-4a83-8e39-7adb2606c07f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.195964 Nov 19 19:29:45.747320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 395/734] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:45 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:45.750848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:45.752525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:45.761125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:45.761721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:45.762633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:45.763217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:45.836473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3db64446-6537-40e8-b3a4-4398fea35b8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091868 Nov 19 19:29:45.837825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 396/735] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:46.184304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:46.197180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:46.202726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:46.203994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83611479-8b83-4277-8782-7cdab937d0df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.515123 Nov 19 19:29:46.204603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 340/736] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:46.767177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:46.767999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:46.775874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:46.776364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:46.777142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:46.777612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:46.850469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:46.851419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:46.860255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:46.860578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:46.862611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:46.863120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:46.911231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eade476f-c5ce-4e27-aa82-fb8d67777c8b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064400 Nov 19 19:29:46.912273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 341/737] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:46.992297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:47.010095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e3c93b1f-1955-4f7f-86c5-2a92a09d69a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.246431 Nov 19 19:29:47.010845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 397/738] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:46 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:47.226220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:47.226930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:47.235983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:47.236543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:47.237449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:47.237989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:47.438638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:47.448872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:47.450486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:47.451707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1bae03c-6f2e-4224-9167-dc32d96d241d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.229930 Nov 19 19:29:47.452294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 342/739] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:29:47.923915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:47.924852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:47.931804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:47.932247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:47.933116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:47.933465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:47.967500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a76aa592-5622-4978-88b9-bb175f2999f7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047502 Nov 19 19:29:47.968134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 398/740] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:48.031211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:48.031865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:48.039347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:48.039821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:48.040645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:48.041076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:48.193599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:48.201983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da3f0aee-79ad-49f4-ab0a-6a1a87e73106 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.174777 Nov 19 19:29:48.202618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 343/741] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:48 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:48.471031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:48.471630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:48.478359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:48.478841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:48.479577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:48.480006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:48.615422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:48.624089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:48.625587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:48.626773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1355c49-13c0-447a-a8e0-92f08578daee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.160041 Nov 19 19:29:48.627346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 399/742] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:48.980211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:48.981117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:48.987838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:48.988479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:48.989750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:48.990433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:49.023442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3a04fdd7-10e6-4bf8-8545-b49759040aad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Nov 19 19:29:49.023941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 344/743] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:49.222749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:49.223388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:49.230457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:49.230904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:49.231733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:49.232214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:49.390237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:49.398299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-87b59684-2d6a-4b71-bd82-f15f621308e8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.179437 Nov 19 19:29:49.398903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 400/744] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:49 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:49.650739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:49.651327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:49.658706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:49.659321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:49.660218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:49.660813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:49.813773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:49.823334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:49.824818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:49.826084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9e97697d-d67f-4716-91d8-4d6f8f1589ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.179263 Nov 19 19:29:49.826619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 345/745] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:50.035618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:50.036665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:50.044138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:50.044764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:50.045626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:50.046143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:50.105130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef88b0a5-8483-4698-ba8c-6d0a569f7f7a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073032 Nov 19 19:29:50.106233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 401/746] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:50.415263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:50.416033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:50.422278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:50.422721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:50.423493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:50.423918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:50.569497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:50.578841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-86103c0f-98cc-4535-bd49-485fdb852f17 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.167101 Nov 19 19:29:50.579455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 346/747] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:50 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:50.845666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:50.846357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:50.853286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:50.853741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:50.854587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:50.855025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:51.023289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:51.044858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:51.046738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:51.048122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7263402-8895-4a3c-9d5b-3f11708376e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.206697 Nov 19 19:29:51.048830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 402/748] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:51.120862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:51.121675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:51.129419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:51.129870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:51.130693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:51.131129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:51.163564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67f94f28-9b55-4afb-b2d5-4c0b56292fd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046600 Nov 19 19:29:51.164141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 347/749] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:51.600510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:51.601149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:51.608136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:51.608590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:51.609399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:51.609837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:51.795960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:51.804469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-115b185d-7265-4df4-837f-30e897e6c4fc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.207790 Nov 19 19:29:51.805047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 403/750] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:51 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:52.069026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:52.069983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:52.078441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:52.079170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:52.080488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:52.081251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:52.180295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:52.181848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:52.192912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:52.193535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:52.194688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:52.195291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:52.248382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5a015c1c-9860-44a7-91e5-fdf53d792f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074478 Nov 19 19:29:52.249683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 404/751] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:52.256476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:52.265631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:52.267357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:52.268589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-175cb532-8c37-4606-a78a-a1054ca3e57d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.204820 Nov 19 19:29:52.269204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 348/752] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:52.822616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:52.823482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:52.830759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:52.831204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:52.832078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:52.832514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:53.018887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:53.028170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c68f70ec-6b06-418a-bcff-58b5760926be tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.209497 Nov 19 19:29:53.037037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 405/753] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:52 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:53.261869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:53.263842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:53.271187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:53.271638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:53.272644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:53.273176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:53.289174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:53.289770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:53.297236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:53.297687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:53.298554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:53.298994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:53.308931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b548e629-c772-40d2-8ba3-5b36dbeee152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050844 Nov 19 19:29:53.309534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 349/754] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:53.472859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:53.484040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:53.485960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:53.487521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02d3af28-dd78-4f0b-8992-7b0d5e532f40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.203098 Nov 19 19:29:53.488188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 406/755] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:29:54.061764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:54.062392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:54.069044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:54.069471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:54.070320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:54.070753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:54.211881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:54.220326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06d7a00a-e692-44d6-989c-4867340a188a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.161910 Nov 19 19:29:54.220917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 350/756] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:54 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:54.321056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:54.321876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:54.329082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:54.329536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:54.330370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:54.330812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:54.362073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-662309e5-8081-4078-9084-cb59b5fe316a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044842 Nov 19 19:29:54.362647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 407/757] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:54.507536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:54.508152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:54.515994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:54.516444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:54.517233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:54.517677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:54.667082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:54.676134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:54.677762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:54.678958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31c226c8-2b14-4659-a2dc-7f93a13a3e34 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.175397 Nov 19 19:29:54.679503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 351/758] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:55.237085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:55.237680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:55.244349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:55.244808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:55.245592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:55.246025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:55.373032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:55.374205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:55.380704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:55.381216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:55.382101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:55.382610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:55.394400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:55.402823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3361d0f9-95cb-45f9-93d5-78c240e55473 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169429 Nov 19 19:29:55.404429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 408/759] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:55 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:29:55.414838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5f438ca2-9023-49d8-b42c-7380119d0b3e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Nov 19 19:29:55.415383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 352/760] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:55.697480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:55.698102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:55.704864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:55.705172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:55.705951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:55.706415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:55.848640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:55.857654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:55.859171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:55.860336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e39a60b4-a9bd-4cc7-b87c-6b9ea0b94e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.166985 Nov 19 19:29:55.860896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 409/761] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:56.421870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:56.422879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:56.427246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:56.428177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:56.433535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:56.434326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:56.435516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:56.435879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:56.436269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:56.436432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:56.437308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:56.437839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:56.477944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bba1350c-a050-4f34-82e4-339b1d3f883d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054671 Nov 19 19:29:56.478930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 410/762] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:29:56.595325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:56.603287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1343af54-945a-495a-9dd1-6f73cdbf37dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.185762 Nov 19 19:29:56.603867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 353/763] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:56 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:56.881058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:56.881665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:56.888897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:56.889364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:56.890184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:56.890636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.042400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:57.052184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:57.053740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:57.055155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ddb9b9f5-0c24-4376-b548-5a860203e893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.177888 Nov 19 19:29:57.055788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 411/764] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:57.494989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:57.496533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:57.507173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:57.507920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.509169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:57.509907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.558649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-81703a80-eae0-4477-a52d-b84ff738809d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070841 Nov 19 19:29:57.559299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 354/765] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:57.620861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:57.621447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:57.628689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:57.629283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.630172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:57.630736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.724527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:57.725300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:57.732361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:57.734014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.734014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:57.734552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:57.798246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:57.809296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7775897b-1292-4651-99f2-7e6b18ec93fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.191862 Nov 19 19:29:57.810136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 412/766] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:57.919035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lazy-loading 'services' on Instance uuid c95be893-491f-4bf9-aa24-491855918b26 {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:29:58.037083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d3b9daf6-b7ac-49f9-9c8a-89ff60209f1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments/1b01e443-a918-4a97-b84e-713155e48d8e" status: 202 len: 0 microversion: 2.1 time: 0.316372 Nov 19 19:29:58.038172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 355/767] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:29:57 2021] DELETE /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments/1b01e443-a918-4a97-b84e-713155e48d8e => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:29:58.074442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:58.075598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:58.082094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:58.082545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:58.083333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:58.083995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:58.249304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:58.258735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:58.259800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:58.260979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-679759aa-c79c-47b2-86ba-46fc6a1aa804 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.190442 Nov 19 19:29:58.261551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 413/768] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:58.572104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:58.573126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:58.580804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:58.581302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:58.582145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:58.582649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:58.615677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4dc90e0c-7f7e-4ce6-b7f5-a7d8997955c5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048155 Nov 19 19:29:58.616224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 356/769] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:29:58.828321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:58.829007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:58.836270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:58.836712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:58.837498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:58.837925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:59.033831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:59.042219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ddd899b7-5c8f-41d0-9825-046541b1ea48 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.218403 Nov 19 19:29:59.042810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 414/770] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:29:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:29:59.280445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:59.281058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:59.288589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:59.289224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:59.290230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:59.290726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:59.454536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:59.465599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:59.467507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:29:59.468872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04c01632-ebe8-4d99-ab44-edc6c35a5d51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.192682 Nov 19 19:29:59.469480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 357/771] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:29:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:29:59.629294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:29:59.630433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:29:59.637793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:59.638344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:59.639254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:29:59.639660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:29:59.674090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-97f314fb-8541-4656-b513-9273d9abd904 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Nov 19 19:29:59.674707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 415/772] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:29:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:00.063972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:00.064926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:00.077306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:00.078080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:00.079524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:00.080259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:00.276200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:00.285351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef480274-c7f8-4843-9830-d2bac78307b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.228884 Nov 19 19:30:00.285933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 358/773] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:00 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:00.489439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:00.490633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:00.498628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:00.499086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:00.499911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:00.500349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:00.666336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:00.675602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:00.677198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:00.678406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-582d22e9-de41-45e9-8a3b-abece50b2d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.193194 Nov 19 19:30:00.678979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 416/774] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:00.687288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:00.688437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:00.695190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:00.695778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:00.696622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:00.697081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:00.730635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e31892b9-2f40-4b1d-a876-10ca10b4b86d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048306 Nov 19 19:30:00.731304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 359/775] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:01.303458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:01.304292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:01.312623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:01.313203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:01.314159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:01.314694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:01.463213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:01.474241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07fc14a1-f10e-4e94-8849-4b5203745a13 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.174408 Nov 19 19:30:01.475080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 417/776] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:01 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:01.697180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:01.697812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:01.705010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:01.705589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:01.706529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:01.707060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:01.746710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:01.749354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:01.760754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:01.761527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:01.764044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:01.764855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:01.821880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6158c9d9-a007-4b69-b9d1-f917c0052749 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081896 Nov 19 19:30:01.822979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 418/777] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:01.854953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:01.864516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:01.866003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:01.867204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ea47a2b7-eefe-4c5b-b77e-110dba2f5edb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174001 Nov 19 19:30:01.867778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 360/778] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:02.492723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:02.493365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:02.500724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:02.501180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:02.501983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:02.502459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:02.650147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:02.658543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03df318a-e554-4a1d-9156-4b1f84efcd08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169513 Nov 19 19:30:02.659195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 419/779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:02 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:02.837628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:02.838668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:02.846444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:02.846870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:02.847704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:02.848147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:02.884424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c1cfba24-550a-40e5-b3fa-18708d26f90e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050757 Nov 19 19:30:02.885415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 361/780] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:02.887782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:02.888917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:02.896249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:02.896699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:02.897598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:02.897962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:03.051075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:03.060768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:03.062383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:03.063649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40f7461c-08a1-4ff3-bdc2-aa72accde629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.180701 Nov 19 19:30:03.064236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 420/781] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:03.675745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:03.676349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:03.683354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:03.683797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:03.684645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:03.685060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:03.840977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:03.850543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8220134b-ded8-45db-a5d9-d2b271f2cc32 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178474 Nov 19 19:30:03.851241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 362/782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:03.897208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:03.898296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:03.905736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:03.906278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:03.907121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:03.907594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:03.941809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df0413a2-8353-4db5-9be3-d9b0b294cb40 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048244 Nov 19 19:30:03.942432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 421/783] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:04.082804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:04.083376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:04.090860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:04.091313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:04.092138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:04.092581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:04.246761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:04.260961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:04.264094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:04.266008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4417c3cf-5f9d-414f-a420-c982a96265c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186860 Nov 19 19:30:04.266871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 363/784] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:04.871747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:04.873331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:04.882975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:04.884016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:04.885519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:04.886271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:04.955070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:04.956939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:04.965629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:04.966311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:04.967357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:04.968117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:05.006922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ca45aef-2a09-49a4-8500-8f33b89aa542 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055995 Nov 19 19:30:05.007518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 364/785] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:05.066622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:05.076304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-32e46d19-102c-4649-adcc-1df2fdda4c5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.210952 Nov 19 19:30:05.076873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 422/786] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:04 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:05.298815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:05.299767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:05.308897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:05.309780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:05.311089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:05.311834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:05.475727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:05.485394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:05.486957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:05.488184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17894650-3377-4eb3-a970-af0558803a04 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.197433 Nov 19 19:30:05.488770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 365/787] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:06.020671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:06.021630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:06.029321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:06.029771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:06.030619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:06.031049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:06.062954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ddfb6da2-07af-419c-8ba9-a05c4b4d77b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046007 Nov 19 19:30:06.063534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 423/788] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:06.099054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:06.099732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:06.107187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:06.107668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:06.108529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:06.109002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:06.259359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:06.273235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d6ec3d6-d439-47b7-9e49-a13bdebaf7f6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178212 Nov 19 19:30:06.274241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 366/789] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:06.507884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:06.508571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:06.515645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:06.516147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:06.516989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:06.517439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:06.677645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:06.687212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:06.688740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:06.689979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a340642e-d3b7-4dfb-a944-0ada054a45cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186302 Nov 19 19:30:06.690633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 424/790] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:07.074774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:07.075778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:07.082217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:07.082715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:07.083538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:07.084001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:07.117823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-34098430-0f84-4995-8937-de06b0d24997 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046701 Nov 19 19:30:07.118718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 367/791] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:07.290912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:07.291589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:07.299688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:07.300151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:07.300968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:07.301406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:07.452588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:07.465502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0a0e5b40-a05f-46ab-a71e-a9c4065d166c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.177992 Nov 19 19:30:07.466435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 425/792] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:07.708962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:07.709585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:07.716249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:07.716690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:07.717474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:07.717894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:07.863415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:07.872490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:07.873991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:07.875344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef9ac6cd-8ccf-4ae1-b689-03681baa9464 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.170150 Nov 19 19:30:07.875916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 368/793] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:08.131468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:08.132649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:08.140073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:08.140521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:08.141311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:08.141747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:08.173969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60fcd2c3-37d2-47d0-aca9-5336cc56e878 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Nov 19 19:30:08.174696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 426/794] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:08.494163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:08.494812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:08.501838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:08.502351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:08.503141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:08.503567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:08.644037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:08.653267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b3ba764a-cd0a-4e23-8252-2b91955b2bcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162800 Nov 19 19:30:08.653910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 369/795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:08.895846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:08.895846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:08.901565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:08.902011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:08.902816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:08.903246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:09.050191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:09.059294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:09.060884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:09.062188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23b28550-ec32-415a-a7c6-d2beea9a1227 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.171470 Nov 19 19:30:09.062981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 427/796] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:09.186894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:09.187707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:09.196427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:09.196877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:09.197678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:09.198148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:09.231352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0673b05-6865-40c8-b06b-71a0d9a2a78a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049217 Nov 19 19:30:09.232140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 370/797] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:09.671081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:09.671727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:09.678444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:09.678951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:09.679847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:09.680371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:09.862744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:09.870738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66bf7a3d-9081-4a05-b926-6b00ec508d00 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.203955 Nov 19 19:30:09.871348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 428/798] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:10.086524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:10.087349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:10.094473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:10.095275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:10.096137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:10.096701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:10.245279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:10.247010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:10.262217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:10.262779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:10.265428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:10.266001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:10.311080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5f7c09fb-eeda-4892-a297-defe47736049 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070992 Nov 19 19:30:10.311997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 429/799] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:10.312397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:10.324519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:10.326767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:10.328220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c34c4772-57fd-4a2d-b8c9-0f21e4a405be tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.245784 Nov 19 19:30:10.328876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 371/800] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:10.890068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:10.890893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:10.898320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:10.898892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:10.899928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:10.900463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:11.056634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:11.064946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e44f58e4-2899-4675-90ac-ef5516deda19 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.179486 Nov 19 19:30:11.065531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 430/801] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:10 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:11.329100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:11.330694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:11.342093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:11.342902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:11.344403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:11.345537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:11.351812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:11.352429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:11.360253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:11.360676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:11.361641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:11.362103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:11.392681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb18cfc5-9f10-4f46-b172-0056f4079395 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070736 Nov 19 19:30:11.393387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 372/802] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:11.511226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:11.520923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:11.522429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:11.523653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ec73d10-0bfe-4e5c-9694-9e4ec1314fdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.178123 Nov 19 19:30:11.524186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 431/803] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:12.082003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:12.082678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:12.090014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:12.090552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:12.091477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:12.091914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:12.263173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:12.271967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-db90ce2a-d742-46ca-81ef-7a99ba2c80c3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.193798 Nov 19 19:30:12.282567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 373/804] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:12 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:12.405491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:12.406513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:12.416501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:12.417275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:12.418678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:12.419825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:12.490964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2aad9e09-91ae-4593-a002-898c070084cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089451 Nov 19 19:30:12.491938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 432/805] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:12.543352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:12.544749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:12.551992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:12.552342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:12.553029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:12.553462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:12.693924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:12.703101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:12.704578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:12.705736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c080793-dcf4-469c-a644-1107527de2b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.166365 Nov 19 19:30:12.706338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 374/806] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:13.295938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:13.296978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:13.305379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:13.305942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:13.306921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:13.307478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:13.483198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:13.496909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8b7319fc-6788-4b3e-aa64-273751300ac1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.205524 Nov 19 19:30:13.497809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 433/807] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:13 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:13.505294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:13.507058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:13.514615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:13.515230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:13.516141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:13.516660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:13.551609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-213f4eab-d8ff-47b4-b53d-cbfc3416e90d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050705 Nov 19 19:30:13.552377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 375/808] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:13.724914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:13.725529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:13.732781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:13.733243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:13.736121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:13.736121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:13.912948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:13.922666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:13.924128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:13.925298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-44d48cac-c1dd-4f6d-b4c0-068db4ce305b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.204315 Nov 19 19:30:13.925859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 434/809] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:14.517487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:14.518089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:14.524991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:14.525511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:14.526417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:14.526993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:14.563907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:14.564838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:14.574698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:14.575827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:14.577225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:14.577988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:14.635249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6f5f1b3-5410-4c09-bf57-8cf4bf529b18 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074614 Nov 19 19:30:14.641634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 435/810] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:14.677258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:14.686124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-68def3b0-120e-470f-8b91-ed0bd36cb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.172056 Nov 19 19:30:14.686755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 376/811] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:14.944789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:14.945398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:14.952320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:14.952786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:14.953572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:14.954005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:15.117809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:15.133215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:15.136166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:15.138376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-61c8c55a-57cd-4843-b70a-03b5713eabd3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.196936 Nov 19 19:30:15.139953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 436/812] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:15.652492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:15.654005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:15.664861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:15.665595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:15.666908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:15.667624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:15.705160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:15.706032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:15.707200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6004134-f014-4e74-9b75-c9ffdf9cf52c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061560 Nov 19 19:30:15.707908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 377/813] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:15.712388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:15.712942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:15.713757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:15.714803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:15.870443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:15.878817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00c6e949-c052-41c4-80bd-496bba7e608a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178861 Nov 19 19:30:15.879411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 437/814] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:15 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:16.161562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:16.162599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:16.170851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:16.171604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:16.173026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:16.173762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:16.367845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:16.377267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:16.378817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:16.380021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-364a813b-ed7e-47bc-9d77-5236b4082f5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.222633 Nov 19 19:30:16.380599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 378/815] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:16.720125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:16.721145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:16.728896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:16.729357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:16.730224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:16.730668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:16.765741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-797dec99-57ea-469d-9414-be748c7f3118 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050094 Nov 19 19:30:16.766365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 438/816] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:16.900854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:16.901921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:16.913176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:16.913957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:16.915339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:16.916071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:17.099586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:17.110290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9fb5fc11-ee9b-4896-aecf-416c7d4d0a08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.215869 Nov 19 19:30:17.110924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 379/817] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:16 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:17.398750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:17.399347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:17.405955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:17.406426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:17.407214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:17.407649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:17.600120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:17.610247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:17.611948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:17.613140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d683be74-bc00-4c9a-9692-9641b2224e18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.218183 Nov 19 19:30:17.613696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 439/818] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:17.777521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:17.778728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:17.785957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:17.786341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:17.787160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:17.787580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:17.818706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a899c26-2ecc-4ba2-9794-d07c29c14d70 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Nov 19 19:30:17.819268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 380/819] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:18.136077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:18.136921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:18.145272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:18.145799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:18.146762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:18.147279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:18.308966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:18.316948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6f3d60ab-8689-4b7c-b653-7358e2e18e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.185396 Nov 19 19:30:18.317533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 440/820] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:18.631975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:18.632647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:18.639775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:18.640294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:18.641093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:18.641527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:18.790573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:18.799990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:18.801449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:18.802629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4efc20c-a5df-4cd2-bd55-0de705cf96dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174538 Nov 19 19:30:18.803162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 381/821] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:18.835292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:18.836833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:18.847606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:18.848387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:18.849735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:18.850506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:18.885572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bc2e38cc-f09c-452c-b31b-5a0a425d125b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057162 Nov 19 19:30:18.886235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 441/822] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:19.333812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:19.334627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:19.341472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:19.342154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:19.342970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:19.343456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:19.535960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:19.545124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ff80a55-5d11-472e-bff7-4e4d66daa963 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.214488 Nov 19 19:30:19.545842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 382/823] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:19 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:19.821205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:19.821980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:19.829305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:19.829747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:19.830579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:19.831031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:19.901452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:19.903965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:19.914320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:19.915384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:19.916801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:19.917537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:19.960326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a04c2e5d-ca47-4704-a1ba-ed3a2b2d9663 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066093 Nov 19 19:30:19.960819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 383/824] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:20.011261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:20.023218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:20.024997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:20.026285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6802c8ab-dda5-4622-948f-837e972f4c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.209045 Nov 19 19:30:20.027131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 442/825] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:20.565414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:20.566441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:20.575779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:20.576640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:20.577988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:20.578740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:20.786004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:20.799119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3894c5a0-6326-4859-afcc-344f995a27b6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.239514 Nov 19 19:30:20.800440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 384/826] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:20.976697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:20.978495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:20.989134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:20.989743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:20.991179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:20.991872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:21.035154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7b1db4f-8dda-44c9-9dc9-ba2adb95a1cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064431 Nov 19 19:30:21.041076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 443/827] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:21.047028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:21.047645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:21.054799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:21.055241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:21.056026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:21.056454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:21.235927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:21.249710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:21.251482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:21.253791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ae547cf-248f-476f-9cfb-6104d927433e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.210071 Nov 19 19:30:21.254161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 385/828] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:21.821820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:21.822668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:21.829809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:21.830201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:21.830978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:21.831400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:22.010936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:22.021602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3188504d-3176-45e1-86c5-5fb29b52c4c7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.203541 Nov 19 19:30:22.022504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 444/829] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:21 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:22.050392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:22.051939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:22.061809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:22.062433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:22.063634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:22.064152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:22.118005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f2905015-91d7-4e46-afa6-ec8e45f276fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071912 Nov 19 19:30:22.118889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 386/830] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:22.281550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:22.282500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:22.292614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:22.293259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:22.294536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:22.295182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:22.516374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:22.530592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:22.532906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:22.534721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-17a95ac7-3623-4fcc-badd-183ec357d7b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.261362 Nov 19 19:30:22.535374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 445/831] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:23.044677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:23.045324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:23.051707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:23.052423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:23.052922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:23.053339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:23.134769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:23.138955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:23.148143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:23.148751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:23.149655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:23.150238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:23.193634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-504efd6c-0e65-43c9-911a-7cb54ab08ce1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064712 Nov 19 19:30:23.194374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 446/832] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:23.249892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:23.258601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ea3f939b-da93-4c81-8d0e-a38f48b13b92 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.217881 Nov 19 19:30:23.259319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 387/833] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:23.558893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:23.559829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:23.567566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:23.568188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:23.569300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:23.569886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:23.729006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:23.739271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:23.740801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:23.742099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34554eb9-3ec0-4db0-98c5-31e7858b0553 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.187192 Nov 19 19:30:23.742962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 447/834] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:24.205181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:24.206444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:24.217235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:24.217728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:24.218597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:24.219060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:24.253425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-919ac869-4dee-49b9-8d8c-55c03665f51f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051927 Nov 19 19:30:24.253914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 388/835] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:24.275806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:24.276585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:24.283545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:24.284021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:24.284817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:24.285243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:24.461935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:24.470713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9b16bb63-ab51-4832-9c11-c3f20114371b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.198659 Nov 19 19:30:24.471306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 448/836] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:24 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:24.762251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:24.763422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:24.771195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:24.771841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:24.772781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:24.773317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:24.942588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:24.951998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:24.953454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:24.954687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-02937614-0bda-49b8-b14c-a2ea55ceb335 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.197140 Nov 19 19:30:24.955253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 389/837] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:25.265862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:25.266966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:25.273789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:25.274281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:25.275102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:25.275539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:25.311845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-503df05a-b199-414a-8a19-dd5318c0f5f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050297 Nov 19 19:30:25.312772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 449/838] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:25.488278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:25.488865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:25.495688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:25.496150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:25.497398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:25.497398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:25.666596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:25.674477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46a9b55b-0d9a-4d59-b0d6-b6fef8a061aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.189838 Nov 19 19:30:25.675046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 390/839] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:25 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:25.975143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:25.975679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:25.982543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:25.982998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:25.983803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:25.984220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:26.122984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:26.132804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:26.134270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:26.135448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-38db916d-79ef-4b17-a244-5312ecf68020 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164284 Nov 19 19:30:26.136164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 450/840] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:26.323933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:26.324926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:26.331496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:26.331940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:26.332703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:26.333125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:26.364642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3ca68d3b-38f1-4826-9cbb-21f363bd3c44 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044430 Nov 19 19:30:26.365343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 391/841] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:26.691787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:26.692513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:26.700284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:26.700735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:26.701570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:26.701983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:26.850007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:26.858241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-69034038-cbb3-40f7-ac66-527ebdddb408 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.170037 Nov 19 19:30:26.858843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 451/842] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:26 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:27.154897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:27.155794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:27.162962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:27.163407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:27.164225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:27.164657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:27.338262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:27.348266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:27.349819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:27.351084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19511de4-e321-4141-ba99-1bb0442ef266 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.200178 Nov 19 19:30:27.351670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 392/843] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:27.377943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:27.379055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:27.385515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:27.385955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:27.386784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:27.387257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:27.422183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab42a7f8-b360-4b4c-bc43-370d466cc09d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Nov 19 19:30:27.422706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 452/844] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:27.877559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:27.878238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:27.884912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:27.885380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:27.886176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:27.886579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:28.043693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:28.051753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6140d6d1-9f31-4944-ada9-912437bf454d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.177925 Nov 19 19:30:28.052318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 393/845] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:27 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:28.372380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:28.372950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:28.380167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:28.380616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:28.381379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:28.381810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:28.435709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:28.437155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:28.446585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:28.446971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:28.447759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:28.448173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:28.481630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0d09566-ce6e-45aa-83b1-1f59195d7649 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050999 Nov 19 19:30:28.482376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 394/846] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:28.596430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:28.605548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:28.607227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:28.608414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d9f2ab42-809e-4920-9731-1c2f106ec347 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.240397 Nov 19 19:30:28.608981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 453/847] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:29.069647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:29.070200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:29.078421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:29.078878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:29.079703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:29.080135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:29.246691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:29.255901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-51bbb1c3-1f56-48c9-ae8f-90e239c1cedb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.190303 Nov 19 19:30:29.256628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 395/848] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:29.493977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:29.495592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:29.503388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:29.503870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:29.504706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:29.505139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:29.539521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3463a4d1-919f-42f8-a3be-171c71eb1436 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049728 Nov 19 19:30:29.540110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 454/849] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:29.634781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:29.635392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:29.643180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:29.643630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:29.644431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:29.644866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:29.801532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:29.811623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:29.813457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:29.814815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-89688c9f-b56f-43ad-9225-be446fa78f64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.184027 Nov 19 19:30:29.815456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 396/850] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:30.281927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:30.282636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:30.289597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:30.290395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:30.291293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:30.291883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:30.462447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:30.470953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1caf436a-8c51-42b0-ae4b-dd086b27bbbe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.193121 Nov 19 19:30:30.471632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 455/851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:30 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:30.554655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:30.555536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:30.563085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:30.563577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:30.564405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:30.564861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:30.596996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ab69ecc-5c66-4b8c-b05c-609577f52384 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046502 Nov 19 19:30:30.597552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 397/852] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:30.837891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:30.838899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:30.850864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:30.851592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:30.852937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:30.853678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:31.041480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:31.056897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:31.059856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:31.062015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc0ddf6b-37ee-4490-9cab-e1c454569efc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.230863 Nov 19 19:30:31.063059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 456/853] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:31.492860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:31.494137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:31.506848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:31.507651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:31.508934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:31.509668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:31.613003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:31.614560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:31.624779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:31.625518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:31.626513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:31.627380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:31.689336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8f1256b-1916-448c-a08b-bafdd4552694 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082718 Nov 19 19:30:31.690853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 457/854] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:31.757594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:31.770735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-75675b0c-0093-4c02-baf9-8d397a07f79b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.284180 Nov 19 19:30:31.771495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 398/855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:32.081452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:32.082458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:32.089609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:32.090093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:32.091092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:32.091549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:32.252857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:32.263858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:32.265461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:32.266864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f763ea5-79a6-4bdc-8e91-b2da3c7194e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.189351 Nov 19 19:30:32.267460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 458/856] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:32.703509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:32.704640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:32.712087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:32.712529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:32.713313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:32.713714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:32.775664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ce9d59a-f141-4a08-879d-b96fc400d487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075995 Nov 19 19:30:32.776435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 399/857] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:32.792458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:32.793654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:32.803197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:32.803936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:32.805272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:32.806011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:32.980466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:32.988805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d483a4b-2a52-4e78-8b97-4fb00e20556c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.202679 Nov 19 19:30:32.989435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 459/858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:32 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:33.290447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:33.291203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:33.298461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:33.298946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:33.299768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:33.300233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:33.446658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:33.462895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:33.465202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:33.466842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6602f4e9-4d9f-476d-8e93-0f3f0a96565b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.181592 Nov 19 19:30:33.467473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 400/859] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:33.789365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:33.790666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:33.798189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:33.798748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:33.799583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:33.800078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:33.834007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7ec30ed4-f9f6-45eb-9b95-597b0e9cb597 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048526 Nov 19 19:30:33.834651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 460/860] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:34.006356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:34.007309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:34.014821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:34.015468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:34.016423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:34.016942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:34.191068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:34.201662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-85db681f-8484-4b29-8a4a-338b406c7161 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.198939 Nov 19 19:30:34.202329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 401/861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:34 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:34.490346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:34.491379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:34.502105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:34.502869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:34.504207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:34.504930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:34.672045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:34.682916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:34.684767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:34.685965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-deb26884-63d7-4550-97f6-ca61f92f5559 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.202537 Nov 19 19:30:34.686602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 461/862] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:34.849929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:34.850884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:34.861468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:34.862271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:34.863616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:34.864332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:34.919768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-42003058-14c8-4d2d-ba3f-059851ae95de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073278 Nov 19 19:30:34.920757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 402/863] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:35.221762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:35.222534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:35.229946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:35.230421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:35.231851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:35.232147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:35.401223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:35.409664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1f5c034e-4910-46e3-aec3-7535b93ef8dc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.192984 Nov 19 19:30:35.410416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 462/864] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:35 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:35.707057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:35.708084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:35.719026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:35.722338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:35.722338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:35.722338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:35.938735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:35.939875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:35.946745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:35.947292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:35.948276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:35.948783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:35.984484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4fe0ccf9-b849-4077-9539-d1148f27d79f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053230 Nov 19 19:30:35.985083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 463/865] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:36.055919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:36.066133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:36.067924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:36.069184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2243cfee-f0d3-495e-8c7a-3da1f8e62bd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.367696 Nov 19 19:30:36.069761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 403/866] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:36.427706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:36.428419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:36.435712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:36.436188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:36.436986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:36.437414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:36.485461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:30:36.485717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:30:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 (ip 10.222.0.46) !!! Nov 19 19:30:36.609189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:36.617738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3d6808b3-7abb-4959-ad56-46008b80640b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.193680 Nov 19 19:30:36.618720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 464/867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:36 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:36.999315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:37.000731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:37.009513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:37.010129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:37.011229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:37.012009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:37.055280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e758cc2-daf0-4c63-89c7-74701f87530f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061707 Nov 19 19:30:37.056462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 404/868] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:37.089943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:37.090845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:37.099559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:37.100438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:37.101410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:37.101934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:37.281960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:37.295232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:37.297146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:37.299184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a91c17d0-1230-4785-8300-a49176c186d8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.213944 Nov 19 19:30:37.299884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 465/869] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:37.639394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:37.640093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:37.648342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:37.649131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:37.650267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:37.650931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:37.858386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:37.884477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee54d3c8-f23f-4b1c-b13a-152491d57541 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.250743 Nov 19 19:30:37.885321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 405/870] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:37 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:38.070296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:38.071634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:38.081854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:38.082636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:38.083941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:38.084491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:38.127274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-187e7be1-0f68-49f5-935e-f33369e4ed0c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061566 Nov 19 19:30:38.128134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 466/871] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:38.331025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:38.331906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:38.340994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:38.341625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:38.342743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:38.343429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:38.533482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:38.546038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:38.548472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:38.550181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3c66b22f-c2d7-4c8c-8d95-792481e39feb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.223722 Nov 19 19:30:38.551332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 406/872] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:38.910021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:38.910021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:38.919199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:38.919974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:38.920914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:38.921743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:39.148109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:39.160885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00cb9bc6-f87a-4b96-a0aa-812c4cc0b878 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.256519 Nov 19 19:30:39.162304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 467/873] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:39.291351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:39.292616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:39.302895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:39.305106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:39.305106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:39.305800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:39.353589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad50d931-f7e8-43de-8ae2-4992e83a63f5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.217644 Nov 19 19:30:39.354706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 407/874] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:39.578321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:39.578932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:39.587515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:39.588219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:39.589508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:39.591324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:39.804254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:39.819339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:39.822018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:39.824019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-62f5962b-254d-4986-8e8b-8ce30fa94644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.250116 Nov 19 19:30:39.825546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 468/875] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:40.187441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:40.188410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:40.198013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:40.198685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:40.200122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:40.200904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:40.369333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:40.370950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:40.383297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:40.384019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:40.385158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:40.385931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:40.394885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:40.410596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-500e7204-b28d-4860-b8e9-39dc05051576 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.228711 Nov 19 19:30:40.414575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 408/876] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:40.439643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd2db3b1-07f6-4392-81fa-fe099d779c3d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075813 Nov 19 19:30:40.440542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 469/877] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:40.846817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:40.847425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:40.855842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:40.856285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:40.857173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:40.857603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:41.091140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:41.105523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:41.110184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:41.112539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c02d4cdb-69ff-4a8d-a2f6-57627c2938ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.270068 Nov 19 19:30:41.113894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 409/878] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:41.438683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:41.440195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:41.447634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:41.448413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:41.449758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:41.450639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:41.456273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:41.459652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:41.476532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:41.477325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:41.479003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:41.479811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:41.537960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a963e46d-8c0f-4a2e-bb30-736d3e71ba79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088085 Nov 19 19:30:41.538978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 410/879] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:41.747131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:41.758603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-369ee5c3-55f5-49d2-b4cc-8ea2baa02915 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.324765 Nov 19 19:30:41.759376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 470/880] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:41 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:42.137494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:42.138454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:42.146851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:42.146851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:42.147849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:42.148279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:42.308137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:42.319376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:42.321228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:42.322475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dac0ef39-b92a-4604-9f79-85815ad7487c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.189351 Nov 19 19:30:42.323047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 411/881] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:42.551296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:42.552234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:42.560012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:42.560468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:42.561298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:42.561734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:42.596429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b945544-79d4-4d8e-90b5-b420500ed973 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049295 Nov 19 19:30:42.597022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 471/882] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:42.787466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:42.788478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:42.801223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:42.801746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:42.802708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:42.803202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:43.031478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:43.041197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-93af9ee1-5b5b-4b35-897a-f3d27428f8fb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.261531 Nov 19 19:30:43.042152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 412/883] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:42 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:43.341360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:43.342765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:43.350177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:43.350614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:43.351415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:43.351845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:43.555967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:43.569181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:43.571404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:43.573338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b544025-7ce1-4127-a4bb-4833e5849e3f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.235954 Nov 19 19:30:43.574726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 472/884] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:43.613998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:43.615160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:43.622836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:43.623289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:43.624125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:43.624707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:43.673965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d5f6e01-6af5-42d1-8a2f-e1b6017cbdfb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068088 Nov 19 19:30:43.674705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 413/885] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:44.063664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:44.064687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:44.072851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:44.073615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:44.078146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:44.078146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:44.265320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:44.281506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6850fbe0-b3a1-4c09-871e-25583f89f734 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.224463 Nov 19 19:30:44.283074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 473/886] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:44 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:44.593199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:44.593936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:44.602562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:44.603311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:44.604670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:44.605476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:44.687730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:44.688758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:44.697058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:44.697815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:44.698719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:44.699291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:44.749170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e1f1f9d5-d00e-422d-8e5a-6b86e9fd9641 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065682 Nov 19 19:30:44.749803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 474/887] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:45.063130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:45.092180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:45.096598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:45.098847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06002fd7-118f-4605-a187-90e30429549d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.509932 Nov 19 19:30:45.099779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 414/888] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:45.313892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:45.315954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:45.327019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:45.327987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:45.329682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:45.332950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:45.526897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:45.537075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8a8e0356-aa27-4c97-837b-56243790469a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.230711 Nov 19 19:30:45.537666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 475/889] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:45 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:45.766822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:45.768457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:45.786530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:45.787347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:45.788870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:45.789539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:45.859621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ab242ae5-8d26-4686-ba02-c99e6da2de04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100488 Nov 19 19:30:45.860434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 415/890] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:46.123102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:46.123995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:46.131940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:46.132611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:46.133705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:46.134692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:46.348303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:46.361671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:46.364069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:46.366091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b13477b5-a5b1-4ded-b371-fd7c3843f48f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.248451 Nov 19 19:30:46.367025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 476/891] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:30:46.564861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:46.566101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:46.575892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:46.576614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:46.577923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:46.578651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:46.743374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:46.752113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2097ec9e-8a3f-4161-8704-7540f3e3cb09 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.194027 Nov 19 19:30:46.752708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 416/892] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:46 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:46.872655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:46.873703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:46.880961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:46.881478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:46.882415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:46.882907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:46.917325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f2e50ed-709e-45db-849c-652237f17668 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048579 Nov 19 19:30:46.918375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 477/893] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:47.395379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:47.396086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:47.403139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:47.403846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:47.405152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:47.405635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:47.566854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:47.577993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:47.579665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:47.580860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad364c5d-10dc-45f6-835e-e33215fa0967 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.190763 Nov 19 19:30:47.581426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 417/894] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:47.778427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:47.779473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:47.788627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:47.789073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:47.789870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:47.790365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:47.935576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:47.937961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:47.946368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:47.947083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:47.948361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:47.949170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:48.003446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:48.007187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dcf74c86-c233-4674-9dca-85444a6eab35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078237 Nov 19 19:30:48.011736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 418/895] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:48.013810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5d29513-9b14-4c7a-8b94-43041fe947d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.240184 Nov 19 19:30:48.014437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 478/896] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:47 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:48.604522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:48.605665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:48.620102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:48.621662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:48.624496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:48.625331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:48.837708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:48.848947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:48.850451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:48.852248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17152569-34aa-429c-95f6-50021a9defbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.254486 Nov 19 19:30:48.852520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 419/897] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:49.019667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:49.020656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:49.029629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:49.030318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:49.031173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:49.031646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:49.036818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:49.037844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:49.047514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:49.048178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:49.049402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:49.050034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:49.067340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f07f3a2c-4f66-4360-b4ac-45f0c9f17d9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051555 Nov 19 19:30:49.067908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 479/898] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:49.264136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:49.272275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9767fe01-f5e8-4484-8db4-7c38582c0959 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.242779 Nov 19 19:30:49.272782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 420/899] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:49 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:49.381808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:30:49.382122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:30:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:30:49.871370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:49.872040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:49.878900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:49.879481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:49.880382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:49.880908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:50.039867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:50.050276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:50.052107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:50.053378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-82e8a315-d377-42b4-ad81-b1f5803d6225 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186452 Nov 19 19:30:50.053964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 480/900] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:50.079889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:50.080843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:50.088876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:50.089300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:50.090806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:50.091165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:50.125398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-053608bf-3a26-4095-a5f6-16a1900100a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049215 Nov 19 19:30:50.125957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 421/901] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:50.297378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:50.297996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:50.304924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:50.305368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:50.306228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:50.306666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:50.463813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:50.477813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bf18460f-5a18-4477-b8f8-bea6c781e50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.183900 Nov 19 19:30:50.478920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 481/902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:50 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:51.072824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:51.073453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:51.080518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:51.081196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:51.081846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:51.082348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:51.140425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:51.142037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:51.153550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:51.154403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:51.155819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:51.156560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:51.204701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b539b769-4354-43fb-9ca2-0dbce553894d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071154 Nov 19 19:30:51.205367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 482/903] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:51.254011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:51.264232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:51.265732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:51.266995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1b1af683-8bb9-41bd-9b1d-81f60e4ec405 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.198193 Nov 19 19:30:51.267714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 422/904] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:51.497752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:51.498740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:51.505493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:51.505938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:51.506761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:51.507186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:51.657626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:51.672216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d595aeaf-79c9-4c02-aa8b-e25a105606c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178585 Nov 19 19:30:51.673132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 483/905] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:51 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:52.218321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:52.219596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:52.226512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:52.226955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:52.227736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:52.228163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:52.265704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af4b6760-f49a-4366-b35d-e09f7ea5507d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051635 Nov 19 19:30:52.266388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 423/906] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:52.286890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:52.287511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:52.294482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:52.294926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:52.295707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:52.296110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:52.445468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:52.454542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:52.456162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:52.457373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9a90c88f-9b0d-45f3-8ead-78002e05f060 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174741 Nov 19 19:30:52.457994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 484/907] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:52.690795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:52.691510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:52.698607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:52.699183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:52.700085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:52.700555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:52.871845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:52.881144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1812ca0b-a05c-4bf7-bb52-80a3d2828fcf tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.194216 Nov 19 19:30:52.881722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 424/908] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:52 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:53.278078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:53.279104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:53.285716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:53.286190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:53.286982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:53.287841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:53.322736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-605d9fcc-d8b5-4df8-b6ca-decd6855f151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048548 Nov 19 19:30:53.323333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 485/909] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:53.476677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:53.477644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:53.485007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:53.485493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:53.486390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:53.486885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:53.640543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:53.649582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:53.651060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:53.652370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-56c24531-21ad-4cbb-9486-6abd4a7dd34f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.179839 Nov 19 19:30:53.653147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 425/910] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:53.903820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:53.904924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:53.915491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:53.916256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:53.917758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:53.918477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:54.087073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:54.095647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b7b2c939-a629-44bb-99fb-f2f143b917bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.199814 Nov 19 19:30:54.096230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 486/911] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:53 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:54.335389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:54.336365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:54.343496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:54.344080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:54.345283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:54.345788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:54.381761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8209d7ff-3183-4f97-8c6e-6f08ab2c7eb5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050326 Nov 19 19:30:54.382804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 426/912] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:54.671097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:54.671817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:54.678997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:54.679453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:54.680261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:54.680686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:54.827453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:54.837996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:54.839690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:54.841108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b48f1c3-1e61-48b3-bf1b-f72abe17d392 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.173981 Nov 19 19:30:54.841796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 487/913] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:55.120974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:55.122309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:55.129646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:55.130172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:55.131032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:55.131505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:55.300762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:55.310226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b6157d9-635d-4216-855e-96653ac09c07 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.192943 Nov 19 19:30:55.310983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 427/914] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:55 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:55.396714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:55.397701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:55.405143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:55.405658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:55.406638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:55.407115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:55.444031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-92078af0-9bd9-4aa1-8494-4ba5518ccac7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050849 Nov 19 19:30:55.444986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 488/915] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:55.869990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:55.870572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:55.878662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:55.879313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:55.880261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:55.880896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:56.065843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:56.075816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:56.077492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:56.078903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-298a2fe8-e919-4a51-9526-0e70a6889042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.212979 Nov 19 19:30:56.079536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 428/916] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:56.335109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:56.335777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:56.343308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:56.343758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:56.344941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:56.345374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:56.457603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:56.459151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:56.466619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:56.467192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:56.468118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:56.468733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:56.508673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-18732929-3489-48fa-99dd-c1c8dac16feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055093 Nov 19 19:30:56.509469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 429/917] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:56.509642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:56.519449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a028126e-baaa-40ed-b900-ed95d0c0bfb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.188121 Nov 19 19:30:56.520126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 489/918] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:56 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:57.100805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:57.101523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:57.111254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:57.111740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:57.112573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:57.113087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:57.278428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:57.287946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:57.289421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:57.290642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3f753039-d942-4eb4-9b2b-e84170231d23 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.194647 Nov 19 19:30:57.291245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 430/919] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:57.523178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:57.524131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:57.531877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:57.532326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:57.533137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:57.533561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:57.537853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:57.538898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:57.546354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:57.546898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:57.547830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:57.548370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:57.583609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e0d0d49-bbf6-4d84-aeb5-25ccb10d1b2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063993 Nov 19 19:30:57.584599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 490/920] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:57.729959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:57.738706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5eba32f6-268d-4e7f-8cc4-cdd27e818830 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.205356 Nov 19 19:30:57.739535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 431/921] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:30:58.320337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:58.321132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:58.328161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:58.328652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:58.329658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:58.330223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:58.518197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:58.528895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:58.530913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:58.532268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02021703-f5b2-40e6-b9de-008c00fc69b1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.216186 Nov 19 19:30:58.532915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 491/922] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:58.596989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:58.597805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:58.604784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:58.605217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:58.606016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:58.608115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:58.639970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9bf081b2-cba4-41fa-a424-6e788fab6ff1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Nov 19 19:30:58.640529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 432/923] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:30:58.766633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:58.767727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:58.779004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:58.779798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:58.781224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:58.781988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:58.943330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:58.952062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e439e16d-6bc0-4af7-878a-b69cc45cc153 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.191647 Nov 19 19:30:58.952758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 492/924] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:30:59.551569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:59.552193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:59.559511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:59.559961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:59.560784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:59.561233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:59.653417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:59.654561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:59.661646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:59.662377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:59.663749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:59.664505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:59.716596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46f4ce10-5270-4183-8476-ba507d3395df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067921 Nov 19 19:30:59.717473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 493/925] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:30:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:30:59.740888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:59.756320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:59.759051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:30:59.761123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4408905a-4ea0-48bf-b829-4a959484b65d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.213108 Nov 19 19:30:59.762324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 433/926] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:30:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:30:59.892885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:30:59.893190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:30:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:30:59.974610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:30:59.975693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:30:59.986718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:59.987400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:30:59.988689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:30:59.989444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:00.162185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:00.170683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ba288d7-15ed-4536-bb1e-c0ebebb99582 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.203193 Nov 19 19:31:00.171482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 494/927] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:30:59 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:00.731904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:00.732722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:00.739825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:00.740274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:00.741062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:00.741668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:00.773970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0bac062d-4dda-447a-b1c6-812761bef9ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046515 Nov 19 19:31:00.774580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 434/928] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:31:00.790130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:00.790749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:00.797453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:00.797899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:00.798738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:00.799171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:00.974164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:00.985164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:00.986706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:00.987926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc6e882d-110a-436c-b1ca-005249725e1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.201741 Nov 19 19:31:00.988506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 495/929] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:01.187941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:01.188581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:01.195543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:01.195992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:01.196786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:01.197219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:01.379909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:01.388077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ca7b66ab-9600-49d3-97b0-8d03f98c615d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.203852 Nov 19 19:31:01.388666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 435/930] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:01 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:01.786792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:01.787728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:01.794841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:01.795881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:01.796091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:01.796533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:01.828332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1033c2d4-f8c6-4aa0-88b2-8c9c0e605196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Nov 19 19:31:01.828910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 496/931] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:02.007035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:02.008030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:02.016247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:02.016698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:02.017487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:02.017920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:02.181652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:02.191199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:02.192759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:02.194086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8cbc3486-fc5f-4b72-89e6-03af236c6477 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.190828 Nov 19 19:31:02.194662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 436/932] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:02.410390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:02.411400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:02.420799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:02.421396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:02.422342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:02.422857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:02.585766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:02.594480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e68d0c15-b8be-40b1-ba8f-34b82fb07ce6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.192105 Nov 19 19:31:02.595094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 497/933] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:02 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:02.840505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:02.841409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:02.848464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:02.848906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:02.849682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:02.850147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:02.882435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6bd90ea-e9fd-46a1-856a-79426e12fd71 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045652 Nov 19 19:31:02.882988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 437/934] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:03.214103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:03.215450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:03.222769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:03.223432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:03.224347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:03.224873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:03.397504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:03.412605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:03.415924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:03.417968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1c57194e-7b42-41da-9a45-aa9df0f7c4e8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.207695 Nov 19 19:31:03.425449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 498/935] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:03.617693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:03.618473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:03.626027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:03.626507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:03.627304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:03.627707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:03.800494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:03.809331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bd4a147b-b114-4e83-9c77-b11929e4ec94 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.195441 Nov 19 19:31:03.809877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 438/936] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:03.894991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:03.896133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:03.903181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:03.903838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:03.904765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:03.905286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:03.939856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f7a1f667-2422-4780-b02a-54fd50023403 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048894 Nov 19 19:31:03.940418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 499/937] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:04.445092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:04.445704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:04.455435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:04.456157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:04.457596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:04.458329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:04.620146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:04.629772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:04.631295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:04.632469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-25673d12-7e78-4ba3-aede-721961b2bd99 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191741 Nov 19 19:31:04.633029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 439/938] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:31:04.827552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:04.828215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:04.835216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:04.835703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:04.836476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:04.836889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:04.956500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:04.957720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:04.964904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:04.965505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:04.966354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:04.966798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:04.989806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:05.000826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0058b8a8-592d-410b-bfbd-02ae183bac3c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051546 Nov 19 19:31:05.001718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 440/939] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:05.002499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84956453-edf7-49ba-acac-9e37049f13da tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178709 Nov 19 19:31:05.003467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 500/940] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:04 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:05.652305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:05.653018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:05.659917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:05.660293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:05.661078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:05.661509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:05.802084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:05.810969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:05.812431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:05.813596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b8d3a634-124f-4642-9da6-913a6cfa1fa8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.165293 Nov 19 19:31:05.814162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 441/941] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:06.014446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:06.015380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:06.020486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:06.021097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:06.022338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:06.022800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:06.023580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:06.024015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:06.028235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:06.028724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:06.029497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:06.030240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:06.054361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52f6b459-9b86-464b-a632-e68e2b60dec1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Nov 19 19:31:06.055250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 501/942] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:06.168395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:06.176250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-54f22ddc-fa62-49c5-8fb0-9d5c8484611b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159367 Nov 19 19:31:06.176860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 442/943] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:06.832369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:06.832957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:06.839898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:06.840459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:06.841280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:06.841711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:06.990976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:07.001177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:07.002718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:07.004048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23a1f44a-e737-4e5e-8c6b-0c41692f66dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.175395 Nov 19 19:31:07.004642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 502/944] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:07.066695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:07.067625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:07.074959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:07.075416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:07.076221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:07.076658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:07.110007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-394b4ea7-2d27-4919-8614-fdfbe9f2bda4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047006 Nov 19 19:31:07.110527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 443/945] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:07.193026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:07.193700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:07.200732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:07.201212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:07.202003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:07.202468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:07.339712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:07.347726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c8325b65-c7b6-402b-a231-2c196b3a565f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.158357 Nov 19 19:31:07.348318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 503/946] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:08.023165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:08.023800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:08.030565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:08.031005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:08.031782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:08.032231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:08.122630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:08.123788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:08.130390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:08.130849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:08.131643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:08.132078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:08.164052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74ad596f-c100-4638-a817-20f620437b37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046494 Nov 19 19:31:08.164643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 504/947] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:08.178140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:08.187722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:08.189237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:08.190511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35f091f4-d6e2-426a-843e-63b92a08fd89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.171213 Nov 19 19:31:08.191089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 444/948] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:08.364626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:08.365267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:08.372228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:08.372673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:08.373476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:08.373904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:08.523383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:08.531700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74926deb-dcf2-4da5-a25e-98dace37b96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.170704 Nov 19 19:31:08.532277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 505/949] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:09.175983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:09.176895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:09.186790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:09.187856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:09.188843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:09.189558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:09.211409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:09.212053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:09.218650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:09.219454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:09.220250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:09.220682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:09.225554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-63e756a4-67d5-4399-b10e-c33f4636c07e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053309 Nov 19 19:31:09.226119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 445/950] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:09.357537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:09.366678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:09.368007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:09.369175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e7138b89-fbee-4ce3-83a7-c73b067768a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164184 Nov 19 19:31:09.369750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 506/951] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:09.549750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:09.550400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:09.557214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:09.557834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:09.559425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:09.559860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:09.706643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:09.714374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-850b5261-6b68-4bb8-84fd-c98abf459fb2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168184 Nov 19 19:31:09.715082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 446/952] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:10.237154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:10.238085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:10.244863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:10.245408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:10.246212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:10.246644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:10.278812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dcd4a86b-c916-4606-b11b-fa839464368d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045401 Nov 19 19:31:10.279394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 507/953] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:10.388624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:10.389205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:10.396048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:10.396489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:10.397248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:10.397681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:10.533986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:10.542787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:10.544265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:10.545415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4dde21dd-c1f6-4008-8297-5a081a363d93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.160629 Nov 19 19:31:10.545944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 447/954] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:10.732094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:10.732706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:10.739111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:10.739562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:10.740331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:10.740766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:10.888117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:10.896166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8df1551-a698-4259-bc57-0c2c2fa1d50c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.167981 Nov 19 19:31:10.896724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 508/955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:10 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:11.290584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:11.291521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:11.298100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:11.298576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:11.299343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:11.299770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:11.329456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ae8902d-0f38-43f9-af6a-20905e642d0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042584 Nov 19 19:31:11.330002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 448/956] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:11.564783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:11.565327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:11.572078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:11.572530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:11.573401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:11.573875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:11.708804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:11.720127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:11.721615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:11.722820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-901e3f83-ee58-4ba3-89c2-26f40e8027f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162040 Nov 19 19:31:11.723392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 509/957] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:11.913926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:11.914812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:11.921544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:11.921954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:11.922806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:11.923241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:12.067875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:12.076315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-29c72f9b-f5ce-42ce-beff-1dd70b081e56 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.165934 Nov 19 19:31:12.076984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 449/958] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:11 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:12.341048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:12.341958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:12.349048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:12.349492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:12.350313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:12.350741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:12.380600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52369831-f262-47f5-a026-f480d4358e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043350 Nov 19 19:31:12.381157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 510/959] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:12.742359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:12.742957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:12.749573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:12.750016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:12.750816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:12.751227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:12.891039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:12.900084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:12.901578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:12.902767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4cb0f69c-b4fc-4bc4-95fc-fa71ae16196f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164250 Nov 19 19:31:12.903335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 450/960] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:13.092928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:13.093442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:13.100579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:13.101031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:13.101815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:13.102288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:13.243293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:13.251409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4c501518-70df-4bff-af42-3e76f8b2a850 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162282 Nov 19 19:31:13.251963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 511/961] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:13 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:13.392751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:13.393573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:13.400384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:13.400838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:13.401731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:13.402209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:13.432575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19ad00e4-a4d3-4d77-93ca-ce554af0bdbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Nov 19 19:31:13.433199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 451/962] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:13.921425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:13.922113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:13.928496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:13.928936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:13.929729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:13.930199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:14.069986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:14.078886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:14.080366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:14.081646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e947c2ae-0884-4e86-b6f5-761e88ee9b53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164134 Nov 19 19:31:14.082236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 512/963] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:14.268545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:14.269149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:14.275664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:14.276121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:14.277245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:14.277675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:14.419466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:14.427341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83f46996-5fbe-4b32-a845-6fcee357d301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162457 Nov 19 19:31:14.427926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 452/964] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:14.447086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:14.447973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:14.454904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:14.455352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:14.456127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:14.456575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:14.490684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-10632bf7-84c7-4d6b-bc44-bd568b37134a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048528 Nov 19 19:31:14.491331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 513/965] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:15.100678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:15.101380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:15.107667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:15.108120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:15.108925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:15.109362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:15.247178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:15.256208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:15.257679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:15.258867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-89ea8c2f-ea74-4a4a-9a15-596b8732695b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.161859 Nov 19 19:31:15.259418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 453/966] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:15.444317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:15.444959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:15.451895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:15.452381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:15.453160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:15.453595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:15.502487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:15.503364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:15.510140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:15.510500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:15.511381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:15.511698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:15.542778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-56a4cc79-044e-4abb-9bfc-7809998d2387 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044007 Nov 19 19:31:15.543355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 454/967] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:15.588331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:15.596308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6104120b-dfd7-4f0b-84e4-ca65af05c660 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.155739 Nov 19 19:31:15.596847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 514/968] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:15 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:16.277135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:16.277822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:16.284415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:16.284872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:16.285646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:16.286076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:16.419375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:16.428307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:16.429762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:16.430965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-20f870e3-6296-4016-8899-68d6fe345062 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.157977 Nov 19 19:31:16.431535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 455/969] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:16.554227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:16.555186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:16.562014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:16.562494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:16.563261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:16.563688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:16.593145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c4824114-21c6-4cc3-8174-9425491e2af9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042669 Nov 19 19:31:16.593723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 515/970] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:16.613353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:16.613945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:16.621680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:16.622038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:16.622875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:16.623299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:16.765324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:16.773083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c09fa4b-4218-4460-a1f1-67513ce469f2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163483 Nov 19 19:31:16.773654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 456/971] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:16 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:17.449382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:17.450089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:17.457456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:17.458025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:17.458923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:17.459355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:17.591617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:17.600976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:17.602468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:17.603627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ac45afa4-d14c-4e81-aad6-cd8d48f5616f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.158276 Nov 19 19:31:17.604170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 516/972] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:17.604852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:17.606190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:17.612750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:17.613190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:17.613959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:17.614543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:17.642531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4e954d4-6629-4c64-b562-bbca32a19a9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041383 Nov 19 19:31:17.643077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 457/973] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:31:17.789683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:17.790323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:17.796632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:17.797112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:17.798368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:17.798866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:17.940471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:17.948035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b98ea87d-68b5-40a5-a2bd-47812faac513 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162005 Nov 19 19:31:17.948865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 517/974] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:17 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:18.622597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:18.623197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:18.630447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:18.630867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:18.631960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:18.632420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:18.654673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:18.655624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:18.662516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:18.662960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:18.663753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:18.664185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:18.694696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6bb6d398-c7c8-496a-ba24-cf9811d9b744 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043871 Nov 19 19:31:18.695530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 518/975] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:18.767252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:18.775570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:18.777155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:18.778326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5205b701-9ba2-4166-8873-c451972b2644 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.159761 Nov 19 19:31:18.778881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 458/976] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:18.965797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:18.966452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:18.973403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:18.973845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:18.974650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:18.975078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:19.116731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:19.124254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e1778ce-2e78-4ec4-a915-a364b1a3297f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162246 Nov 19 19:31:19.124796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 519/977] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:19.706643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:19.707564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:19.715057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:19.715479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:19.716318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:19.716745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:19.750704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-24a3bd77-0aff-4e0d-b4a4-8208d10bfd03 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047795 Nov 19 19:31:19.751280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 459/978] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:19.797564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:19.798193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:19.806210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:19.806867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:19.808189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:19.808844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:19.951691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:19.960404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:19.961822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:19.963018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-12cae7b4-5743-4825-86ba-4ecd4ff22a38 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.169309 Nov 19 19:31:19.963579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 520/979] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:20.141161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:20.141757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:20.148264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:20.148707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:20.149464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:20.149891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:20.285464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:20.293379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-373701a9-4741-4c96-82b3-11345d2e2cc7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.155839 Nov 19 19:31:20.293943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 460/980] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:20.761892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:20.762844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:20.769414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:20.769866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:20.770746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:20.771184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:20.801301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9726219b-3eb1-434d-bc4c-d3ececcb81c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043197 Nov 19 19:31:20.801957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 521/981] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:20.982081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:20.982698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:20.989557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:20.990008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:20.990817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:20.991249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:21.128904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:21.138385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:21.139898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:21.141018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e400f929-9dd3-4c23-b9af-fa18f6b244ef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.163036 Nov 19 19:31:21.141595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 461/982] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:21.310284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:21.310893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:21.317807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:21.318304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:21.319098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:21.319535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:21.459141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:21.466432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52b5b5f5-2d15-417e-9d9c-6f110cc13152 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.160054 Nov 19 19:31:21.466993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 522/983] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:21 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:21.812586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:21.813517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:21.820030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:21.820477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:21.821256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:21.821691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:21.852352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-50c2dd4d-1b9d-4ee3-93c4-3d35443f8e25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 Nov 19 19:31:21.852945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 462/984] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:22.160897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:22.161473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:22.167963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:22.168412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:22.169189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:22.169619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:22.316784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:22.326593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:22.328070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:22.329263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4a230098-047e-4133-9b36-7bde3554be3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.172245 Nov 19 19:31:22.329841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 523/985] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:22.483500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:22.484137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:22.490739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:22.491183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:22.491942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:22.492385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:22.628046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:22.635682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d3ab3f1-4683-45c1-87d6-c3761059f96a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.155755 Nov 19 19:31:22.636270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 463/986] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:22 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:22.864353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:22.865313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:22.872309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:22.872752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:22.873521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:22.873954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:22.903609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f236393-4239-4746-a30e-8cef1133e9ec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Nov 19 19:31:22.904165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 524/987] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:23.348722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:23.349317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:23.355835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:23.356281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:23.357082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:23.357514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:23.496544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:23.505039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:23.515618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:23.515618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b95a401a-2ea2-4fa6-a4f0-05bc8b630ed5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162655 Nov 19 19:31:23.515618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 464/988] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:23.652931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:23.653534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:23.660339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:23.660770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:23.661535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:23.661964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:23.798448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:23.805850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a171996-07ed-4d99-83c8-1d80e78d1233 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.156750 Nov 19 19:31:23.806422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 525/989] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:23.914877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:23.915792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:23.923795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:23.924235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:23.925046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:23.925469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:23.956336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4014456d-1a1b-4a83-9697-4295c5716a76 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Nov 19 19:31:23.956892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 465/990] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:24.526219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:24.526623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:24.533558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:24.534011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:24.534849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:24.535285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:24.671928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:24.681424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:24.683105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:24.684349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d27b7796-5e1b-4c83-b8e2-a9fcb4828234 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162421 Nov 19 19:31:24.684935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 526/991] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:24.823453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:24.824376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:24.831487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:24.831932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:24.832727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:24.833164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:24.968494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:24.969814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:24.976761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:24.977214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:24.978222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:24.978631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:24.978896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:24.987485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-702a86c5-9526-49eb-9c1e-b614bb05dbf8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.167851 Nov 19 19:31:24.988078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 466/992] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:24 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:25.009531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6035264-6cd1-49c7-856d-2ef454222653 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044782 Nov 19 19:31:25.010074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 527/993] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:25.298700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:31:25.299225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:25.306359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:25.306806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:25.307695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:25.308126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:25.330829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lazy-loading 'flavor' on Instance uuid 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:31:25.407662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fdc5261a-ce61-4207-b20e-f70d05288466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "POST /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae/action" status: 202 len: 0 microversion: 2.1 time: 0.112570 Nov 19 19:31:25.408165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 467/994] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:31:25 2021] POST /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:31:25.416369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:25.417154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:25.423515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:25.423966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:25.427223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:25.427223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:25.565014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:25.572852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00546ad7-b2fa-4dd8-95aa-ad49ff6dc62c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.159996 Nov 19 19:31:25.574227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 528/995] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:25.703993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:25.704652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:25.711460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:25.711903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:25.712686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:25.713121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:25.849278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:25.858349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:25.859859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:25.861022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e20e580-9247-47f6-9e80-9c09ab67d632 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.161273 Nov 19 19:31:25.861580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 468/996] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:26.005249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:26.005826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:26.013072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.013517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.014337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.014784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.020905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:26.021826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:26.029189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.029656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.030555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.031003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.063401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8cb6abc5-da0a-412a-a492-06b5dd5115f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046296 Nov 19 19:31:26.063968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 469/997] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:26.152207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:26.159652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9232c269-967a-4acb-8c3a-483c0b640c55 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.158153 Nov 19 19:31:26.160194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 529/998] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:26 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:26.600746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:26.601426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:26.608224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.608671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.609458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.609898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.751727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:26.760284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-77e3bbcf-2614-49bb-a9a0-8ff39878c05c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163037 Nov 19 19:31:26.760888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 470/999] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:26.879963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:26.880575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:26.887140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.887582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:26.888356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:26.888782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.026526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:27.035903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:27.037369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:27.038567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89fdac17-a8d6-4e0f-9e69-450fa5c0b43b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162393 Nov 19 19:31:27.039129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 530/1000] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:27.075525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:27.076651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:27.083218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:27.083608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.084378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:27.084810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.131335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e94d168-0712-4c67-aa7a-45efb4363a19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059913 Nov 19 19:31:27.131889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 471/1001] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:27.177042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:27.177678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:27.185430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:27.185891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.186726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:27.187152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.338328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:27.346961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-06ef7b20-8c73-4b14-9708-43bfa761f89a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173658 Nov 19 19:31:27.347563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 531/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:27 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:31:27.777737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:27.778379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:27.784516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:27.784961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.785812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:27.786285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:27.925008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:27.932988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-05f9bfc6-a01a-433c-b2b5-fe0748249c9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158947 Nov 19 19:31:27.933558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 472/1003] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:28.058403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:28.059187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:28.065992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.066479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.067269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.067706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.143294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:28.144221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:28.150763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.151403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.152221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.152648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.183443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de6d51f0-b606-441b-a2f5-60e42e7ee7df tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Nov 19 19:31:28.184113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 473/1004] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:28.201751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:28.210279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:28.211785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:28.212950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0951743d-c5ad-443a-a53a-2af2d216a04e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.158953 Nov 19 19:31:28.213514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 532/1005] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:28.363899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:28.364516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:28.371451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.371897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.372691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.373122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.508852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:28.516827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0168d16c-2709-4af5-9130-1d1fbbe28c61 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.156688 Nov 19 19:31:28.517401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 474/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:28 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:28.950698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:28.951302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:28.957912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.958412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:28.959187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:28.959666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.095843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:29.103831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a47e449-6ed9-46af-9f5c-ae2707ac737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.156956 Nov 19 19:31:29.105179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 533/1007] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:29.195162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:29.196702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:29.205266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:29.205715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.206527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:29.206953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.231705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:29.232331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:29.238674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:29.239128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.239599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-22fdee71-c229-4572-91b1-1de98a436611 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048295 Nov 19 19:31:29.239912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:29.241037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.241209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 475/1008] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:29.381429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:29.390653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:29.392119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:29.393281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ed42a97-6e6e-4b23-9165-9739c19ee2c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.165519 Nov 19 19:31:29.393840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 534/1009] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:29.536922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:29.537827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:29.545822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:29.546306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.547083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:29.547511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:29.689833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:29.697266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-20d57e00-8067-41d5-b723-6f3dbb2532ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.166199 Nov 19 19:31:29.697885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 476/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:30.121948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:30.122573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:30.129259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.129698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.130502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.130928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.255567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:30.256483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:30.263807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.264249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.265023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.265453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.270890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:30.279516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ab4cf21-7acb-40fd-bd84-177879f32d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161345 Nov 19 19:31:30.280097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 535/1011] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:30.296543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ae08754-7020-43ec-9f9c-0ced3a61c30f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048848 Nov 19 19:31:30.297177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 477/1012] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:30.411748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:30.412262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:30.419355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.419837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.420614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.421046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.563595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:30.572437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:30.573951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:30.575151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-63eab59f-fd06-40cc-b6a9-1a1013e6d622 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.167236 Nov 19 19:31:30.575696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 536/1013] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:30.715019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:30.715552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:30.722487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.722938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.723711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:30.724153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:30.874223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:30.882083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-23fcf4d3-13b0-416a-a480-a5565f44d0ff tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171185 Nov 19 19:31:30.882796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 478/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:30 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:31.296814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:31.297516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:31.304363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.304812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.305587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.306015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.307743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:31.308645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:31.315335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.315788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.316577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.317010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.348405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eb01e17d-9df2-4376-bf21-f0f92393663a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044606 Nov 19 19:31:31.349015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 479/1015] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:31.444280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:31.452668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03c829a4-b5c3-4867-8b3f-7e3ea77c0466 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.159492 Nov 19 19:31:31.453246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 537/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:31.593666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:31.594684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:31.601155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.601598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.602399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.602821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.737561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:31.745911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:31.747428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:31.748588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-beb7ea59-80ca-405f-b68f-0f655297fb3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.158724 Nov 19 19:31:31.749159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 480/1017] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:31.900164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:31.901013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:31.908847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.909482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:31.910281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:31.910890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.061849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:32.069682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c7aa6e8-1d66-4332-be7d-5b84dcac2f77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173719 Nov 19 19:31:32.070302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 538/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:32.360339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:32.361344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:32.368477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:32.368924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.369759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:32.370230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.403681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc3c1cb1-34a4-4348-a825-d94e4f12de7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Nov 19 19:31:32.404291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 481/1019] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:32.470361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:32.470988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:32.477852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:32.478352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.479143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:32.479570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.623357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:32.630969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a106c0e2-045a-479d-938e-f4f792dd5b04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.164976 Nov 19 19:31:32.631540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 539/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:32.766898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:32.767494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:32.773817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:32.774323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.775083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:32.775509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:32.911949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:32.920684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:32.922221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:32.923366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6f627fe-7bf4-4ef2-9aad-b4c1c1f7f66e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.160283 Nov 19 19:31:32.923924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 482/1021] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:33.087448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:33.088054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:33.095507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.095960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.096740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.097178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.237464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:33.245043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a0ad3b6d-6758-4ed0-a549-bada23a439e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.161343 Nov 19 19:31:33.245611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 540/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:33 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:33.415756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:33.416679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:33.423647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.424099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.424885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.425321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.457197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa446393-be4e-43d9-a285-38d65774ffbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Nov 19 19:31:33.457702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 483/1023] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:33.648490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:33.649102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:33.656161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.656608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.657386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.657849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.795769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:33.803478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ba5447d0-0525-4a7e-a1b8-5051b41fdf1c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158700 Nov 19 19:31:33.804032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 541/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:33.943581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:33.944182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:33.950273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.950722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:33.951490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:33.951915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.095457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:34.104046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:34.105729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:34.106896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-23c0a2ce-add2-44e1-a1f5-159376d2a930 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.167265 Nov 19 19:31:34.107465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 484/1025] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:34.262390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:34.262912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:34.269377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:34.269832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.270650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:34.271087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.422083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:34.429856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2423f5ef-2a1d-4076-aadf-2af0a78cacb5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171387 Nov 19 19:31:34.430467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 542/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:34 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:34.469372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:34.470324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:34.477004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:34.477447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.478260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:34.478682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.508885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9d58e3ec-15a1-4e15-a2a5-f5cf2228666f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043638 Nov 19 19:31:34.509433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 485/1027] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:34.821131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:34.821804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:34.828610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:34.829082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.829856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:34.830321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:34.974333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:34.983275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-58f42478-00fd-4f33-b939-5705d4b20aae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165687 Nov 19 19:31:34.983877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 543/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:35.125448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:35.126066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:35.132243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:35.132668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:35.133449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:35.133871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:35.282456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:35.291301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:35.292865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:35.294084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2f59b896-566e-45da-b336-ebe23dd22496 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.172296 Nov 19 19:31:35.294675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 486/1029] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:35.447357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:35.447999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:35.454900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:35.455343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:35.456107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:35.456528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:35.520705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:35.521592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:35.528352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:35.529075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:35.529883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:35.530379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:35.560669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35f19e05-43ca-460e-a0d8-639c96d8c477 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043699 Nov 19 19:31:35.561224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 487/1030] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:35.595254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:35.602701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a01ae31a-2469-4090-9301-9e45f151a858 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159107 Nov 19 19:31:35.603254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 544/1031] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:35 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:36.001130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:36.001772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:36.008449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.008899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.009704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.010180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.313399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:36.314021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:36.321066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.321515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.322355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.322786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.489252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:36.497571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8a700bd6-e093-4627-a921-8bfe83b41550 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.500099 Nov 19 19:31:36.498226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 488/1032] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:36.567465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:36.572156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:36.573063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:36.576153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:36.577636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:36.578833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14deb8a1-83d9-4aa0-a2f2-d807d400f7e9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.269384 Nov 19 19:31:36.579388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 545/1033] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:36.580176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.580621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.581404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.581836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.612445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-66a9c31e-34de-4d59-983e-8c02632e6aa5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Nov 19 19:31:36.612994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 489/1034] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:36.618916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:36.619528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:36.625766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.626265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.627041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:36.627482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:36.764443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:36.772283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02c3ac45-bb58-44e8-9787-df67f537c91e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.157076 Nov 19 19:31:36.772852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 546/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:36 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:37.514314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:37.514919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:37.521320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.521752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.522560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.522982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.597568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:37.598252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:37.605355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.605941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.606787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.607216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.694871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:37.703156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ebc27a4-490c-4199-8192-b633a556afb4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.192742 Nov 19 19:31:37.704048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 490/1036] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:37.709573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:37.710766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:37.717852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.718343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.719553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.719954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.754778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-999dfa8c-3bd8-41a0-8d10-dca11006ca50 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048786 Nov 19 19:31:37.755342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 491/1037] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:37.775772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:37.784683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:37.786176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:37.787356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-413cbe91-12d5-4bb7-a2dd-92ea3d2d0d7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.193945 Nov 19 19:31:37.787963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 547/1038] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:31:37.790312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:37.790983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:37.797324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.797780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.798589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:37.799081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:37.949881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:37.957530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d2865e03-2faa-4cd7-ba36-42188fb822b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171118 Nov 19 19:31:37.958376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 492/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:37 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:31:38.721241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:38.721824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:38.728581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.729032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.730221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.730823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.765685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:38.766770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:38.773336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.773780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.774609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.775035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.806323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17ea87a5-0fa9-4cc3-b28a-a899c88c4223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044224 Nov 19 19:31:38.806876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 493/1040] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:38.813317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:38.813917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:38.820099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.820561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.821337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.821785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.876997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:38.884360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-546005a8-7173-44ae-9d97-da383a3c003c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167314 Nov 19 19:31:38.884910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 548/1041] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:38.960472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:38.969649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:38.971146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:38.972378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da9df240-fd97-4460-bdef-abf50064e504 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164533 Nov 19 19:31:38.972879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 494/1042] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:38.975229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:38.975838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:38.982359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.982800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:38.983553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:38.983980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:39.119472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:39.127450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-757c9d88-ca70-4faf-9ecf-a855f6b04e51 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.156038 Nov 19 19:31:39.128016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 549/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:39.817582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:39.818519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:39.827762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:39.828433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:39.829672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:39.830355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:39.865367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1444b6bc-9704-40e6-bcca-23d9d767bb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051498 Nov 19 19:31:39.865934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 495/1044] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:39.901228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:39.901911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:39.909040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:39.909515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:39.910351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:39.910819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:39.990665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:39.991271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:39.998163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:39.998579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:39.999400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:39.999826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:40.087271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:40.098787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0991270d-999c-4aba-97c4-1c4b0efdf1ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.201004 Nov 19 19:31:40.099833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 550/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:40.144911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:40.145691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:40.151858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:40.152307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:40.153103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:40.153586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:40.172489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:40.189040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:40.189040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:40.189040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11f8446a-ec55-4520-9b38-6bb107545a3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.197352 Nov 19 19:31:40.189514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 496/1046] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:40.290952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:40.298984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-69471630-6ab6-409f-8fa0-84f4c3124394 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.157846 Nov 19 19:31:40.299553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 551/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:40.878384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:40.880540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:40.888371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:40.888812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:40.889619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:40.890036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:40.919428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a455a790-8873-4073-ab9f-f58edf181458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Nov 19 19:31:40.919989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 497/1048] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:41.117795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:41.118441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:41.125225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.125675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.126514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.126926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.203128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:41.204060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:41.210502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.210946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.211726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.212172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.303403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:41.311682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5fc39e5e-8992-4ae3-9c07-7d114e411a14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.197540 Nov 19 19:31:41.312245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 552/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:41.316589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:41.317194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:41.323312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.324093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.324891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.325328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.402094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:41.410748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:41.412240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:41.413390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8c6e763f-57ca-4187-bdf4-b4dabd98258e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.214533 Nov 19 19:31:41.413944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 498/1050] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:41.476863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:41.484990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9c91ca71-365e-4d2a-ae30-4b24fa412c98 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171750 Nov 19 19:31:41.485566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 553/1051] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:41 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:41.931444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:41.932546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:41.941970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.942420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.943211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:41.943642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:41.975720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-550658b4-b823-4010-82b3-b42019479769 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048000 Nov 19 19:31:41.976277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 499/1052] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:42.328647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:42.329237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:42.338322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.339473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.340023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.340689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.432593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:42.433282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:42.439528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.439962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.440742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.441168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.634402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:42.643457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d7d70dc-8bcd-48f3-9371-1de268fc65c8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.318312 Nov 19 19:31:42.644067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 554/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:42.648610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:42.649220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:42.656528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.656992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.657782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.658251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.758397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:42.768054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:42.769771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:42.770987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ffd71c99-f6bd-41fc-983c-127062150c3b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.342774 Nov 19 19:31:42.771760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 500/1054] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:31:42.852959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:42.861069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-28af1e8a-c4cf-4bc4-9202-65acbff0d3f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.215990 Nov 19 19:31:42.861876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 555/1055] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:42 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:42.893407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-0ed59fd6-d249-4d0c-98e0-02560679e874 req-ae1d1ee1-2215-41ca-b6d3-0a15e4e67361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1894db7d-c20a-4bcc-8fd3-cf13d214a5ae", "name": "network-vif-unplugged", "status": "completed", "tag": "52339b2d-1214-4a37-8df2-c8f15a213a8a"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:31:42.895498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:31:42.895498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:31:42.903595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-0ed59fd6-d249-4d0c-98e0-02560679e874 req-ae1d1ee1-2215-41ca-b6d3-0a15e4e67361 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.904030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-0ed59fd6-d249-4d0c-98e0-02560679e874 req-ae1d1ee1-2215-41ca-b6d3-0a15e4e67361 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.916147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-0ed59fd6-d249-4d0c-98e0-02560679e874 req-ae1d1ee1-2215-41ca-b6d3-0a15e4e67361 service nova] Creating event network-vif-unplugged:52339b2d-1214-4a37-8df2-c8f15a213a8a for instance 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae on hv-cinder-77703 Nov 19 19:31:42.921945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-0ed59fd6-d249-4d0c-98e0-02560679e874 req-ae1d1ee1-2215-41ca-b6d3-0a15e4e67361 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098930 Nov 19 19:31:42.922580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 501/1056] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:31:42.987700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:42.988702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:42.995039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.995484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:42.996253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:42.996675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.025499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b4f0c260-1b99-49c9-b9b6-16c776b6b2e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041600 Nov 19 19:31:43.026121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 556/1057] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:43.662160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:43.662846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:43.669800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:43.670292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.671067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:43.671495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.790288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:43.790907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:43.797871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:43.798369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.799165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:43.799606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.811629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:43.819638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b08ccee9-41d1-4fee-9032-63bb0a6a47c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.162146 Nov 19 19:31:43.820214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 502/1058] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:43.878086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:43.878794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:43.884984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:43.885415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.886541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:43.886977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:43.961779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:43.972082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:43.973572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:43.974820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a2bd0a2b-f8d3-4021-a1f9-786e06b1c46a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.188429 Nov 19 19:31:43.975348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 557/1059] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:44.036659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:44.037248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:44.038309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:44.044320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06bc4cc2-b7c9-4b0c-ae95-6a1b9608d6a7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.170001 Nov 19 19:31:44.044547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:44.044881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 503/1060] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:43 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:44.045046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:44.045766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:44.046309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:44.083207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4f572e46-5145-43bc-b0e4-7f674ee99a89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049802 Nov 19 19:31:44.083781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 558/1061] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:31:44.838269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:44.838996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:44.846188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:44.846626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:44.847396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:44.847813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:44.991511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:44.994113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:44.994739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:45.000729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72d5b121-c774-4e5b-9ef0-f89b4a3a0787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166319 Nov 19 19:31:45.001562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 504/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:45.006367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:45.006868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:45.008004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:45.008220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:45.061250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:45.061857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:45.068641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:45.069093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:45.069892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:45.070358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:45.198688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:45.208369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:45.210112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:45.211455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-05bb3ae5-e8fb-41a5-a07a-6f09f62af1db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.221545 Nov 19 19:31:45.212680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 559/1063] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:31:45.217995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:45.219340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:45.226075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:45.226529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:45.227322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:45.227764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:45.259621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:45.267371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fbb3aa44-b701-44b2-8ea0-7b8ceef59629 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.210088 Nov 19 19:31:45.267709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89c68978-b1f3-4127-894e-7833a4f497fa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053805 Nov 19 19:31:45.267949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 505/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:45 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:31:45.268274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 560/1065] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:46.017337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:46.017983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:46.024672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.025111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.025899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.026670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.171303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:46.179804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-338cd503-219f-4c2d-9576-d117fba7ddd8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166126 Nov 19 19:31:46.180399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 506/1066] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:46.231662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:46.232271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:46.239088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.239538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.240314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.240743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.279529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:46.280418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:46.286773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.287213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.287989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.288411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.318667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a9b116f7-af25-422d-a0ca-36848404aa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Nov 19 19:31:46.319284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 507/1067] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:46.323538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:46.324130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:46.330661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.331111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.331893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:46.332323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:46.387228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:46.396119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:46.397707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:46.399012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-829561b7-76d0-4ba5-8e54-53184c6ae270 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.171590 Nov 19 19:31:46.399653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 561/1068] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:46.479894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:46.487767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0c17b3d-4754-4792-9e26-8a2b12008291 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.167572 Nov 19 19:31:46.488340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 508/1069] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:46 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:47.196814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:47.197463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:47.204491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.204934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.205723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.206196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.330279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:47.331130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:47.337791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.338263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.339722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.340160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.345537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:47.353348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e2d2a096-97ac-48f8-ba85-2cc6f733eac8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.160463 Nov 19 19:31:47.353923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 562/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:47.372416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ce221f1-738c-4796-9ef9-5140235a1b29 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046033 Nov 19 19:31:47.372992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 509/1071] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:47.419165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:47.419741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:47.426190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.426644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.427434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.427978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.505596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:47.506267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:47.512851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.513286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.514101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:47.514516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:47.595550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:47.605031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:47.606610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:47.607857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ae03e66e-8072-40b6-b87b-7c8a930cf9d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.193532 Nov 19 19:31:47.608415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 563/1072] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:47.674871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:47.683162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f3f0cef9-db54-4cbe-8e93-bd177f1522ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.181547 Nov 19 19:31:47.683793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 510/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:47 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:48.372160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:48.373350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:48.380863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.381350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.382173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.382613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.383773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:48.384672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:48.393392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.393826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.394637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.395071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.431248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a2e0d80b-3068-4ee0-b876-a303e2fdd81f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Nov 19 19:31:48.431248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 511/1074] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:48.554406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:48.562909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f785c0d4-809c-4e62-923c-491f8eb88124 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.196041 Nov 19 19:31:48.563899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 564/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:48.626967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:48.627561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:48.634259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.634679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.635490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.635914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.702635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:48.703151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:48.710081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.710538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.711331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:48.711887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:48.825895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:48.834980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:48.836449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:48.837620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-07b21ce1-934d-4692-9e91-f4ba0e7e84ff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.214593 Nov 19 19:31:48.838500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 512/1076] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:48.894742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:48.902031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a5b1d22-9ea9-4e04-9c06-d58ce0885aea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.204914 Nov 19 19:31:48.902639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 565/1077] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:48 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:49.439381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:49.440261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:49.447069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.447517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.448308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.448929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.479828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d13d762-185d-465c-b122-7e5d9a497f9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044238 Nov 19 19:31:49.480397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 513/1078] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:49.581578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:49.582365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:49.589337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.589876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.590691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.591151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.728897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:49.737632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bee5b0a0-4590-4c72-a474-6ff19dbe2f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.159661 Nov 19 19:31:49.738266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 566/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:49.856717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:49.857314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:49.863739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.864185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.864955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.865379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.919033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:49.919645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:49.925964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.926413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:49.927214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:49.927655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:50.034324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:50.043141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:50.044605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:50.045795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-18b99ea9-8824-4a8d-a368-eacd08f0496c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.193048 Nov 19 19:31:50.047087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 514/1080] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:50.099478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:50.107924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c842069a-d309-4dad-8b39-79367bb7446c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.192565 Nov 19 19:31:50.108503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 567/1081] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:49 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:50.493338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:50.494269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:50.500944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:50.501385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:50.502188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:50.502612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:50.533078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6338f5e5-ccb5-4807-bf68-027274008ab0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045107 Nov 19 19:31:50.533645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 515/1082] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:50.754976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:50.755578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:50.762373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:50.762821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:50.763602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:50.764039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:50.911367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:50.919441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b55b431-4a5f-4f5b-9af8-5a4de7b235e2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168101 Nov 19 19:31:50.919989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 568/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:51.064978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:51.065475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:51.072085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.072515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.073565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.074072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.125833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:51.126637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:51.133229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.133765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.134603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.135042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.241065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:51.249968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:51.251516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:51.252684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0649d7e-3528-4e45-a8f9-b9b9a318a438 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191606 Nov 19 19:31:51.254918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 516/1084] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:51.313281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:51.321294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8441388-5def-4478-b9e8-b50d84163530 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.199164 Nov 19 19:31:51.321798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 569/1085] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:51 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:31:51.545651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:51.546582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:51.553288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.553734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.554544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.554971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.585244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b33db8f5-0116-48f4-8c16-c329ff76823c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Nov 19 19:31:51.585713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 517/1086] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:51.936403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:51.936979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:51.943736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.944185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:51.944966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:51.945393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.082535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:52.090644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-98be62a9-bb8e-42dd-b862-47bc920ea6b9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158027 Nov 19 19:31:52.091222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 570/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:52.271557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:52.272173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:52.279199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:52.280043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.280875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:52.281310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.338359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:52.339229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:52.346212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:52.346692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.347459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:52.347917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.446500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:52.455565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:52.457029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:52.458278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95e12083-66b1-4ca6-8771-6603ba913247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.190438 Nov 19 19:31:52.458756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 518/1088] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:52.512658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:52.521532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-896f7201-dea4-4510-8f2e-279d453b7ebe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.186610 Nov 19 19:31:52.522242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 571/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:52 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:52.598020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:52.598955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:52.607641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:52.608066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.608870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:52.609303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:52.640354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a0f4e8c8-b6f5-4360-abb5-7302f57bbf5c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046416 Nov 19 19:31:52.640924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 519/1090] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:53.108575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:53.109216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:53.115958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.116400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.117183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.117610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.261353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:53.270206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60d24b4e-34ae-4ad7-a655-d91e7bd7462d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165371 Nov 19 19:31:53.270778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 572/1091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:53.478069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:53.478564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:53.485179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.485614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.486433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.486843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.539204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:53.539829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:53.546841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.547285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.548059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.548504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.654634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:53.663603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:53.665099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:53.666346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-963c8339-01f1-4c67-ac3f-d8b2cfdbaff4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.192218 Nov 19 19:31:53.667592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 520/1092] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:53.671923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:53.672884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:53.679315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.679758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.680530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:53.680953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:53.711242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-58aee735-2a9a-44c4-9620-33e39293d4d3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Nov 19 19:31:53.711811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 521/1093] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:53.721884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:53.729920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23ff664c-3e08-4ed0-9685-f8cabe9192c9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.194299 Nov 19 19:31:53.730458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 573/1094] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:53 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:54.287939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:54.288553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:54.295322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.295766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.296546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.296977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.439717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:54.451996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b7b82bd3-b45e-43d9-ae77-b50c475e41fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167832 Nov 19 19:31:54.452621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 522/1095] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:54.685807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:54.686394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:54.693057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.693504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.694326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.694741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.723468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:54.725152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:54.732744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.733188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.733982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.734437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.767240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d746186c-01ba-4480-bae8-9a3150abaded tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047451 Nov 19 19:31:54.768108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 523/1096] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:54.772138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:54.772758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:54.779493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.779950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.780723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:54.781204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:54.841785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:54.851556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:54.853042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:54.854346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-42e5c2d4-bf40-4b47-854a-f1323f009c78 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.172424 Nov 19 19:31:54.855179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 574/1097] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:54.928764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:54.936968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c32e85d2-74a1-467b-b077-38f06a0ee2d2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168010 Nov 19 19:31:54.937440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 524/1098] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:54 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:55.469458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:55.470083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:55.476592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.477038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.477827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.478291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.618950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:55.627459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-06c0eefe-df0e-4d2a-8dd1-867c24c1e33a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.162076 Nov 19 19:31:55.628045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 575/1099] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:55.779561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:55.780571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:55.787488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.787941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.788767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.789188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.829272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c4c9e7bf-ae61-44ff-8c31-408fbf36ed8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053726 Nov 19 19:31:55.829733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 525/1100] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:55.873177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:55.873796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:55.880834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.881279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.882198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.882584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.954161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:55.954771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:55.961609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.962052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:55.962913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:55.963368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:56.103718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:56.115107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:56.116726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:56.117936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc798062-52c7-4188-a61e-4e846e8dd6de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.248537 Nov 19 19:31:56.118875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 576/1101] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:56.162968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:56.173152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e62c9656-f000-4f08-8f56-7098d3a93ee3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.222810 Nov 19 19:31:56.173852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 526/1102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:55 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:56.647789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:56.648805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:56.656990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:56.657475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:56.658662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:56.659098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:56.834740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:56.842886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:56.844293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:56.844644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-afb580e2-3e1e-404b-862b-43be86d2bba5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.201857 Nov 19 19:31:56.845301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 577/1103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:56.851265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:56.851757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:56.852586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:56.853013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:56.887429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b65b83bd-2084-4e75-a7c2-762d14597f66 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Nov 19 19:31:56.888030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 527/1104] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:57.138201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:57.138763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:57.145436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.145907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.146722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.147151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.192029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:57.192867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:57.200283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.200791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.201765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.202502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.344130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:57.361108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:57.364256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:57.366362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c579895a-797e-4123-b32d-38e5c7c02f65 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.232616 Nov 19 19:31:57.367380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 578/1105] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:57.412101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:57.420525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0343be41-a2d6-44aa-9cd3-9137c09c9a6e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.232867 Nov 19 19:31:57.421107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 528/1106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:31:57.864625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:57.865546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:57.873850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.874463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.875325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.875770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.902205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:57.904054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:57.912295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.912752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.913569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:57.913996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:57.949593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35431c1f-2198-42c8-868d-d5cc9664ff0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053298 Nov 19 19:31:57.950236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 529/1107] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:31:58.035236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:58.043400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7430c3d7-e0b3-4894-b042-d3a6fb197939 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.183547 Nov 19 19:31:58.043973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 579/1108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:58.395119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:58.395706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:58.404177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:58.404688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:58.405761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:58.408177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:58.438426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:58.439036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:58.446373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:58.446794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:58.447606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:58.448375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:58.619834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:58.630524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:58.632107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:58.633783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9519060c-9899-4e01-9bac-6f3b82790ab1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.242017 Nov 19 19:31:58.634830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 530/1109] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:58.652484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:58.660987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-152c4212-f2ba-4517-807a-5bd151a9c02e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.226211 Nov 19 19:31:58.661615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 580/1110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:31:58.961872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:58.962738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:58.969507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:58.969957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:58.970767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:58.971196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.001401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4a2cef3d-678e-4863-bfd0-7ad255060a1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Nov 19 19:31:59.001968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 531/1111] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:31:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:31:59.061193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:59.061803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:59.068358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:59.068814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.069598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:59.070030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.210933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:59.219706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b1ce38b-7824-4012-b055-3525a0db47b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.162505 Nov 19 19:31:59.220246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 581/1112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:31:59.653576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:59.654227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:59.660995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:59.661442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.662255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:59.662685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.678559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:31:59.679154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:31:59.686417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:59.686873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.687662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:31:59.688099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:31:59.860938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:59.869681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:59.869991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:59.871336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:31:59.872513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-28e2faa2-f4eb-4148-bdb1-e6a714614bfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.223166 Nov 19 19:31:59.873081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 532/1113] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:31:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:31:59.878276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4da769c8-1e9c-4de0-99a3-3db276c69123 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.203335 Nov 19 19:31:59.878845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 582/1114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:31:59 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:00.013697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:00.014679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:00.021686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.022177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.022984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.023416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.058068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-adf3a245-ffb5-47f3-b788-249eecff31b3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048397 Nov 19 19:32:00.058931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 533/1115] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:00.236882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:00.237489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:00.244076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.244490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.245280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.245715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.388726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:00.396451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-faac8024-91e9-4c50-bf3a-011f0f8e0f6d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163274 Nov 19 19:32:00.397023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 583/1116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:00.893153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:00.894277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:00.903835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:00.904522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:00.905086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.905614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.906505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.906944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.912427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.913239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:00.914173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:00.914717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:01.353141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:01.362188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:01.363802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:01.364989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8497f9e0-ff33-4154-ad86-af61c0c2df71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.476985 Nov 19 19:32:01.365551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 534/1117] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:01.367224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:01.370334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:01.371324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:01.376352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-68580f69-8394-44a2-a1e4-b0f9dfafcea3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.476731 Nov 19 19:32:01.377796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 584/1118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:00 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:01.378149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:01.378321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:01.379141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:01.379609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:01.411052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bcdf8bf1-f2ef-44f1-ba47-efab00dfd3b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044379 Nov 19 19:32:01.411697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 535/1119] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:01.414131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:01.414746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:01.421382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:01.421822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:01.422645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:01.423076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:01.568667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:01.577574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5dfd095e-ec2d-426c-b076-2d428e31c08e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167085 Nov 19 19:32:01.578148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 585/1120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:02.383677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:02.384280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:02.391496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.392475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.393620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.393842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:02.394491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:02.394743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.402085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.402527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.403304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.403737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.604779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:02.614556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:02.616140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:02.617480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f995f41f-8ea3-487f-95bf-08f0d62add71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.237828 Nov 19 19:32:02.617934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 536/1121] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:02.622847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:02.623838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:02.625838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:02.631308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.631754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.632540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.632970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.635802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81f98570-ca7e-4a18-aa9a-278a9939a216 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.245702 Nov 19 19:32:02.638619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 586/1122] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:02 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:02.641511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:02.642177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:02.650147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.650574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.652646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:02.653118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:02.665272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a7867be5-d1f4-4aaa-8106-0f91d5b7aa2c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046146 Nov 19 19:32:02.665880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 537/1123] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:02.809346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:02.818316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02576c26-194c-4bca-9c29-1b24262a223e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.180349 Nov 19 19:32:02.819045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 587/1124] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:03.636805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:03.638125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:03.644100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.644556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.645326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.645760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.652821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:03.653437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:03.660182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.660641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.661426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.661862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.841938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:03.851034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:03.852673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:03.854847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8733dfc-eb4f-4ff9-b150-1fa99c9c5891 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.221028 Nov 19 19:32:03.855452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 538/1125] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:03.856676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:03.860309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:03.860734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:03.864834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ea9e36ff-3eaf-47ac-a520-122c32a0624f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.215743 Nov 19 19:32:03.865656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 588/1126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:03.867317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.867764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.868555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.868985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.870275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:03.870949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:03.876904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.877374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.878217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:03.878660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:03.898011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bcb97a75-beb2-4a5f-a078-419fcc8f799b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041457 Nov 19 19:32:03.901987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 539/1127] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:04.012452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:04.020468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d392fbc4-3dec-433c-b4a2-2b06ec30d7c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.153802 Nov 19 19:32:04.021042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 589/1128] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:04.875721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:04.876351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:04.882778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:04.883279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:04.883378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:04.883542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:04.884354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:04.884790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:04.890074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:04.890547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:04.891322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:04.891748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:05.087548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:05.097130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:05.098325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:05.099853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:05.101050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b5e8249-a39a-4d29-af62-374f49c94b36 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.230603 Nov 19 19:32:05.101615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 540/1129] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:05.105869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab2f9f8f-38d0-4023-be20-7d714c9b06ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.226583 Nov 19 19:32:05.107111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 590/1130] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:04 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:05.107238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:05.107770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:05.114151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:05.114605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:05.115401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:05.115785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:05.120835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:05.121471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:05.127454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:05.127841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:05.128621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:05.129093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:05.146289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eb29d66c-5861-472d-8fba-d633ac1d6d16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043393 Nov 19 19:32:05.146860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 541/1131] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:05.267987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:05.275730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c0e3248e-3e36-4ea3-8e3a-b1919ed68fe8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158758 Nov 19 19:32:05.276383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 591/1132] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:06.120195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:06.120837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:06.122395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:06.123035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:06.127659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.128098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.128902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.129327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.129601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.130086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.130867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.131304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.336180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:06.341028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:06.345478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:06.347012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:06.348227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-69c374a3-5b85-4878-9793-7db2cbead022 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.232031 Nov 19 19:32:06.348791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 542/1133] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:06.349883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60937282-23e8-4b14-8f28-5cb2d3eef003 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.231275 Nov 19 19:32:06.365702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 592/1134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:06.366037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:06.366037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:06.366591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:06.366591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:06.366892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.366892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.366892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.366892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.367280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.367280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.367280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:06.367280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:06.397357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-184a2416-8b14-406a-875e-b1de01f8f2c6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Nov 19 19:32:06.397834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 543/1135] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:06.516202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:06.524617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab35b3e9-2479-482b-87e1-3b144ac54227 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.172622 Nov 19 19:32:06.525206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 593/1136] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:07.373695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:07.374315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:07.374606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:07.375226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:07.381183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.381614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.381767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.382249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.382404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.382838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.382991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.383457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.581177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:07.588455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:07.589485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-71969605-6f83-4552-b43d-7f992fd57db9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.219419 Nov 19 19:32:07.590117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 544/1137] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:07.594960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:07.595865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:07.597699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:07.599229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:07.600508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e1a23bb0-fd3f-4253-92f8-8a11b4582b2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.229732 Nov 19 19:32:07.601062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 594/1138] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:07.601685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.602170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.602946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.603378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.605704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:07.606341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:07.612112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.612559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.613330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:07.613759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:07.633538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa957485-525b-4626-bdfd-a4a05d104a1e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Nov 19 19:32:07.634166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 545/1139] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:07.750845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:07.758757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03c847ca-ac0e-44ab-9870-0022d525c5e0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.156655 Nov 19 19:32:07.759372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 595/1140] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:08.607342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:08.607925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:08.614831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.615287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.616069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.616642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.618845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:08.619785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:08.630190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.630640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.631434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.631865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.822639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:08.831362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:08.831606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-81ad757d-dec5-4529-b9e4-5e48e66d5937 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.228089 Nov 19 19:32:08.832184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 546/1141] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:08.837136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:08.838036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:08.841462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:08.843071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:08.844677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ed83583d-4041-4b74-9100-bf3ef5d4c1d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.229539 Nov 19 19:32:08.845284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 596/1142] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:08.845873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.846343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.847148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.847594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.850232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:08.850637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:08.864163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.864563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.865474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:08.865910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:08.882949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e736edf-2eed-4da8-bc4a-9e3b98e368e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049677 Nov 19 19:32:08.883524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 547/1143] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:09.002969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:09.011016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3adda518-121a-468d-95a6-961594f8e8ad tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.164737 Nov 19 19:32:09.011560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 597/1144] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:09.849660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:09.850262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:09.857291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:09.857689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:09.858543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:09.859012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:09.863468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:09.864094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:09.871344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:09.871792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:09.872587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:09.873018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:10.063418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:10.066876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:10.071184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d7dd9fd-f3b1-4758-b8c6-020263cdd484 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.225298 Nov 19 19:32:10.073095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 548/1145] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:10.076657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:10.076844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:10.077777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:10.078329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:10.079636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-42c4852f-980a-4344-806a-56bfdbfb01b4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.219810 Nov 19 19:32:10.080966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 598/1146] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:10.084352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:10.084796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:10.085596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:10.086021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:10.094774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:10.095553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:10.102126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:10.102516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:10.103306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:10.104227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:10.116674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d4b97de-24ee-41cf-8097-0c393da58b7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Nov 19 19:32:10.117250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 549/1147] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:10.243197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:10.251598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eb0b26a8-a12e-4b96-87a7-892b88dd528d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.170026 Nov 19 19:32:10.252175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 599/1148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:11.088131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:11.089084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:11.096297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.096751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.097537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.097976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.098696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:11.099343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:11.106417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.106873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.107676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.108114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.303784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:11.308057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:11.312366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e901f9e-a3ee-4fd3-a808-16b0d52aca1d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.227799 Nov 19 19:32:11.313030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 550/1149] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:11 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:11.317132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:11.317877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:11.318635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:11.318965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:11.319817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f45300a-971a-4e2f-b395-2cc5e5e8dd5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.224917 Nov 19 19:32:11.320608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 600/1150] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:11.324746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:11.325361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:11.327529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.328020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.328772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.329211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.331440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.331885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.332651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:11.333081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:11.363417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2903b351-c22c-4953-af25-a7de47b540c2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049120 Nov 19 19:32:11.363891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 551/1151] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:11.472425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:11.480645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1414c4b9-6d5c-4692-9474-11d743cad92c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.159266 Nov 19 19:32:11.481221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 601/1152] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:12.329641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:12.330281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:12.337136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.337582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.338154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:12.338633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.338929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:12.339126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.346212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.346659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.347451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.347880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.536544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:12.540031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:12.544530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9521880b-a800-4519-b99a-b64f5887b475 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.218492 Nov 19 19:32:12.545115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 552/1153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:12 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:12.549131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:12.549659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:12.550594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:12.550756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:12.551805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c8ee50e2-378f-4ca4-a93f-fc21ff2da8d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.217469 Nov 19 19:32:12.552624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 602/1154] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:12.556526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.557017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.557783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.558341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.566789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:12.567396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:12.574020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.574477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.575297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:12.575727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:12.588748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-015572c7-520f-4aa2-85b3-ac16cd19d3e5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042485 Nov 19 19:32:12.589331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 553/1155] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:12.721430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:12.729999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ac0c455f-4936-40d2-84a8-362600f48059 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166778 Nov 19 19:32:12.730630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 603/1156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:12.973745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:32:12.973992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:32:12 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:32:13.561959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:13.562550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:13.569219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.569654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.570223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:13.570659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.570840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:13.570963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.577907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.578385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.579167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.579606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.779370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:13.783220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:13.787261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e2d2802f-832f-42b6-b4eb-f2b944288cea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.229234 Nov 19 19:32:13.787813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 554/1157] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:13 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:13.792087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:13.793147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:13.793776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:13.794737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:13.794996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14722c83-8821-41cd-8278-6d0520931903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.228461 Nov 19 19:32:13.798098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 604/1158] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:13.800089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:13.800700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:13.802088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.802518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.803322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.803782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.807733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.808283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.809107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:13.809515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:13.835433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-645efd43-03c4-4019-b339-50787f376606 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046479 Nov 19 19:32:13.835910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 555/1159] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:13.946311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:13.954927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00fae55f-74b4-4875-abfb-7c344b62fdce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158144 Nov 19 19:32:13.955500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 605/1160] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:14.804677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:14.805303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:14.812253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:14.812669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:14.812910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:14.813457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:14.813607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:14.813917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:14.820371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:14.820818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:14.821603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:14.822036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:15.015657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:15.020179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:15.026177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c37c8af6-55e8-4580-9919-33b2ecaccefe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.225075 Nov 19 19:32:15.027000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 556/1161] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:15.031098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:15.031816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:15.032145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:15.032999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:15.034245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9a74266-4e6c-4502-ba96-d12c5cf0b1cf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.225202 Nov 19 19:32:15.035824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 606/1162] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:15.038103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:15.038559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:15.039128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:15.039333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:15.039737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:15.039861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:15.047864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:15.048319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:15.049111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:15.049544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:15.071082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31f9c45c-ac82-4c46-998c-1d6c21982326 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Nov 19 19:32:15.071572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 557/1163] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:15.191880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:15.200769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-981fc8a3-d37b-4ae1-8dfb-7d5c20c3b302 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.164897 Nov 19 19:32:15.201557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 607/1164] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:16.044958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:16.045520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:16.052519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.052727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:16.053163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.053366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:16.053732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.054223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.060173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.060597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.061374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.061801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.251764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:16.257226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:16.259944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1493137-5819-4100-a2a5-6abf0e01d958 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.218920 Nov 19 19:32:16.260502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 558/1165] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:16 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:16.265181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:16.266075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:16.271996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.272436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.273196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.273619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.275016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:16.276760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:16.277950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eccd905a-a000-4965-ac96-f85210f62c75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.229081 Nov 19 19:32:16.278509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 608/1166] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:16.282790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:16.283380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:16.289674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.290145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.290923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:16.291419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:16.303790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6d17e38-bf20-4361-93ca-ee23a2df89d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041934 Nov 19 19:32:16.304260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 559/1167] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:16.429779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:16.437876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5bffa029-d4b8-4ca5-b6ef-27e6bae046fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158377 Nov 19 19:32:16.438482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 609/1168] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:17.276861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:17.277417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:17.284201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.284646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.285420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.285838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.296312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:17.296920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:17.303780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.304400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.305190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.305626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.489743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:17.497419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:17.497645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c694ee56-051f-49de-88b8-0a51438eb294 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.224298 Nov 19 19:32:17.497994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 560/1169] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:17 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:17.502450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:17.503348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:17.506693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:17.508291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:17.509093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.509481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-24580e96-cfcc-4f65-8831-b9425ec1040f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.216985 Nov 19 19:32:17.509627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.510266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 610/1170] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:17.510400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.510821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.517272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:17.517868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:17.524011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.524482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.525251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:17.525744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:17.541380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f33d9440-cd30-44e9-bb5e-221f660b1655 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042202 Nov 19 19:32:17.542316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 561/1171] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:17.667915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:17.675791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8fda91ec-41aa-4e41-ae91-c6465b3c82f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161891 Nov 19 19:32:17.676362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 611/1172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:18.514522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:18.515161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:18.521868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.522337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.523141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.523534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.529121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:18.529737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:18.537978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.538466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.539262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.539704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.722362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:18.729587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:18.730279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-65c61b21-406b-4f9a-907b-2120b721591d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.219243 Nov 19 19:32:18.730844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 562/1173] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:18.735500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:18.736322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:18.739094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:18.740540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:18.741695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d9e17401-dae7-4c88-a276-5a6d65aaa4d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.217218 Nov 19 19:32:18.742286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 612/1174] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:18.742480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.742922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.743782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.744598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.746960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:18.747568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:18.753413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.753864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.754691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:18.755124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:18.774087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-15b72ef3-535b-484f-9a3b-660d8e42629b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042191 Nov 19 19:32:18.774898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 563/1175] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:18.890173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:18.897725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9fe410a9-77ee-4294-99ff-8ebf9888952b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.154470 Nov 19 19:32:18.898324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 613/1176] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:19.747315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:19.747951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:19.754691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.755163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.756130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.756559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.760966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:19.761599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:19.768305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.768764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.769551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.769988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.953329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:19.961064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-931ee379-8d58-46ea-b7f0-8aa112008d7d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.217482 Nov 19 19:32:19.961752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 564/1177] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:19 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:19.965544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:19.966908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:19.967833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:19.974552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.975037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.975204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:19.975819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.976274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.976622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:19.977790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c0e09d65-48c9-4b6f-93c6-cfdd5555f698 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.220883 Nov 19 19:32:19.978377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 614/1178] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:19.982746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:19.983351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:19.989278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.989856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:19.990673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:19.991114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:20.007687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6557b9c0-eff2-4371-ab0f-f8148f662cae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Nov 19 19:32:20.008181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 565/1179] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:20.124005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:20.131901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-86dd34ce-aaf6-43bd-98db-38a0b5c096cc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.152505 Nov 19 19:32:20.132440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 615/1180] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:20.979556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:20.980223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:20.986827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:20.987281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:20.988059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:20.988500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:20.996579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:20.997193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:21.003795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:21.004256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:21.005045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:21.005482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:21.189167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:21.197444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3aa75eab-62f3-4840-be48-e5dce89743ab tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.221633 Nov 19 19:32:21.206999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 566/1181] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:21.207371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:21.207489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:21.207489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:21.209475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:21.210164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:21.210975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:21.211396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:21.212075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:21.214082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:21.215422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1f28aef-f368-4174-84ae-e545ef10d6c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.222999 Nov 19 19:32:21.216081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 616/1182] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:21.242350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8f564731-422f-406c-968a-5d47e343fc1f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Nov 19 19:32:21.242921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 567/1183] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:21.332050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:21.332667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:21.339239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:21.339660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:21.340464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:21.340904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:21.479415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:21.487305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48b1f0cd-e371-439b-9db7-dee852082029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.270152 Nov 19 19:32:21.487848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 617/1184] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:22.214683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:22.215285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:22.222380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.222828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.223590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.224017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.234832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:22.235423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:22.243395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.243977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.244973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.245409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.378215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:22.387740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04ae24ca-8274-4e24-b646-3914700a3a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.176714 Nov 19 19:32:22.388477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 568/1185] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:22 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:22.393311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:22.394294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:22.400900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.401419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.402169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.402594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.433957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d89a796-a3df-480f-ac31-7cc317d4943b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Nov 19 19:32:22.434583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 569/1186] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:22.505334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:22.505970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:22.512287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.512699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.513467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:22.513891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:22.536128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:22.545389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:22.546937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:22.548125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eeea8412-7a72-4004-98d9-96b68a21b7e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.317097 Nov 19 19:32:22.549074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 618/1187] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:22.657892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:22.666000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3cec1829-c9a8-4397-a57a-f7158eb28b14 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.164498 Nov 19 19:32:22.666679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 570/1188] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:23.405476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:23.406100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:23.413063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.413517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.414352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.414794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.445043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:23.446181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:23.453403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.453841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.454649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.455073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.488016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-98804c96-8341-4d39-917f-0e72972d0b8a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046730 Nov 19 19:32:23.488604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 571/1189] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:23.557124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:23.564988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cd4005e3-5cbb-4e27-b60a-30808cc8fbc2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163280 Nov 19 19:32:23.565515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 619/1190] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:23.568233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:23.568831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:23.575350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.575785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.576581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.577004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.683018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:23.683622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:23.689858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.690376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.691156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:23.691583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:23.714909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:23.723946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:23.725420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:23.726607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0ea74cd-e88f-49f4-b009-a1d6e3eac657 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162144 Nov 19 19:32:23.727168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 572/1191] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:23.825695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:23.833713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20fd4ce1-ae52-4fd3-bd21-c303c2e2d11a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.154380 Nov 19 19:32:23.834308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 620/1192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:24.499458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:24.500366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:24.507317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.507686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.508486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.508910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.539012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2dab1c00-6ee4-45b8-8419-d804aaf9a7f6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Nov 19 19:32:24.539660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 573/1193] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:32:24.582602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:24.583179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:24.592938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.594804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.595648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.596094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.732606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:24.740076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b698258c-8f92-4b47-9456-d055aaf6d8f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.161131 Nov 19 19:32:24.740646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 621/1194] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:24 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:24.745189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:24.745796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:24.752062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.752515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.753264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.753697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.851337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:24.851956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:24.858968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.859420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.860231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:24.860665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:24.895894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:24.905451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:24.907143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:24.908303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2fe57c7d-de56-43e9-80f5-d464ae9cbcdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.167461 Nov 19 19:32:24.908857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 574/1195] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:24.996048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:25.003916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8c9c382c-fdf3-41b1-a9b7-4ef7eb620cb5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.156303 Nov 19 19:32:25.004478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 622/1196] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:25.551326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:25.552178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:25.559376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:25.559816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:25.560589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:25.561007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:25.594411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-00d9b0ef-677e-4b5c-bdcd-157b58987433 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046873 Nov 19 19:32:25.594986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 575/1197] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:25.757890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:25.758533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:25.765496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:25.765946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:25.766768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:25.767204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:25.906956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:25.914566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59d01560-f255-4aa6-a1f4-d24074bb2768 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.160457 Nov 19 19:32:25.918178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 623/1198] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:25 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:25.926838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:25.927452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:25.934002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:25.934479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:25.935323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:25.935755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:26.020814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:26.021395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:26.028118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:26.028567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:26.029376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:26.029809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:26.072741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:26.081777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:26.083291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:26.084448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2c66db72-5a33-4f87-a746-42eada539fa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.161352 Nov 19 19:32:26.085035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 576/1199] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:26.171781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:26.179414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ec9147b-9bdc-4b6e-942d-1645f4bf087e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.162452 Nov 19 19:32:26.179968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 624/1200] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:26.608613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:26.609645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:26.617103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:26.617547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:26.618357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:26.618790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:26.649596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-692e1b73-2a35-4bd4-8513-0daea66e8b78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046704 Nov 19 19:32:26.650194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 577/1201] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:26.931809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:26.932388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:26.939075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:26.939524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:26.940312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:26.940778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.082998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:27.091261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71fa05d3-1805-41cb-8617-338ccc3b1545 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163331 Nov 19 19:32:27.091828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 625/1202] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:26 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:27.103234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:27.103946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:27.110192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:27.110642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.111420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:27.111858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.196594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:27.197493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:27.204966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:27.205418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.206259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:27.206697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.256864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:27.265871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:27.267389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:27.268553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8950c14-87b5-4b6a-a3d5-4971d6cb107f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.169060 Nov 19 19:32:27.269118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 578/1203] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:27.354076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:27.362079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-10c3e5c4-2d24-4eaa-8274-7016943238b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.169213 Nov 19 19:32:27.362676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 626/1204] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:27.661864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:27.662801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:27.669909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:27.670386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.671164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:27.671590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:27.701955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba08d1ca-d769-49bf-8bcd-1e131ffdbe4a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Nov 19 19:32:27.702551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 579/1205] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:28.108812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:28.109446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:28.116335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.116755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.117538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.117975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.254578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:28.262103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14020765-8dfd-40bf-a174-575ba1a4e60e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.157029 Nov 19 19:32:28.262698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 627/1206] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:28 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:28.286949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:28.287554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:28.293600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.294056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.294858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.295296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.379190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:28.379836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:28.386344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.386792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.387582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.388019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.441854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:28.451107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:28.452603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:28.453764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-247a07d4-0674-48bb-8c42-f7dd5761c6a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.170587 Nov 19 19:32:28.454354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 580/1207] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:28.533020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:28.542273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-118db262-a9b0-4135-92ca-d0bb820ecb49 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166218 Nov 19 19:32:28.543293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 628/1208] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:28.714181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:28.715002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:28.722323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.722769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.723546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:28.723968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:28.755966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b50c377-efa6-4d52-9418-8eaecaa08121 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045582 Nov 19 19:32:28.756546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 581/1209] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:29.280182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:29.280823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:29.288481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.288933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.289816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.290434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.435063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:29.448341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ecbb1b58-98c9-44d0-af23-e6ba227e43e1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173208 Nov 19 19:32:29.448929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 629/1210] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:29.472658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:29.473237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:29.480131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.480598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.481381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.481811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.560798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:29.561302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:29.567234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.567680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.569118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.569555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.654337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:29.663487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:29.664617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:29.666092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ede022c6-8dec-4510-8816-3b144aea0b4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.197438 Nov 19 19:32:29.666632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 582/1211] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:29.728470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:29.737229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0812a838-56ce-4af8-b2bb-c1ecdd95b49c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.180173 Nov 19 19:32:29.737761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 630/1212] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:29.767836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:29.768740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:29.775476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.776088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.780039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:29.780039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:29.807142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b93c565c-e64e-42e7-bf52-769cc109ecf4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042979 Nov 19 19:32:29.807704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 583/1213] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:30.467731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:30.469221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:30.477603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.478174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.478880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.479306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.631718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:30.639838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aafbfddd-de19-42f7-8548-46a099da163e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.177797 Nov 19 19:32:30.640391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 631/1214] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:30 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:30.685559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:30.686192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:30.692503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.692943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.693710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.694164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.755557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:30.756166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:30.763552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.764225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.765152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.765633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.863596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:30.872497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:30.873952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:30.875168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-285cad94-aa62-4e81-a738-ccbe00f67641 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.194019 Nov 19 19:32:30.875719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 584/1215] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:30.880038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:30.880942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:30.891688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.892123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.892891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:30.893325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:30.930034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ed3af8fb-e5af-4d91-819d-a624db27cbaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053231 Nov 19 19:32:30.930870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 585/1216] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:30.934823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:30.942730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-13e0cdb4-22a7-41de-a2f7-ff4c9f47b13b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.190895 Nov 19 19:32:30.943297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 632/1217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:31.656529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:31.657049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:31.663442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.663885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.664641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.665069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.803218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:31.811080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da68912a-27cd-4194-84e8-87f8451c86f0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.158345 Nov 19 19:32:31.811617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 586/1218] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:31.893062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:31.893666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:31.900446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.900896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.901672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.902141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.940959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:31.941803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:31.948285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.948762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.949551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.949979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.981839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3cae40b3-da77-4220-b1dc-734d991690e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044660 Nov 19 19:32:31.982484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 587/1219] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:32:31.986795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:31.987394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:31.993906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.995549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:31.996352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:31.996822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:32.049310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:32.058589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:32.060112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:32.061288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5d3f479f-231e-41fc-884a-6cc108b5581a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.172035 Nov 19 19:32:32.061871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 633/1220] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:32.146222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:32.154864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f298111b-85dd-4c9b-917d-c9cdc22bd057 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.171355 Nov 19 19:32:32.155451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 588/1221] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:32.828041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:32.828644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:32.835127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:32.835577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:32.836351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:32.836780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:32.973333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:32.981945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1292f828-1785-4d5b-88f1-6b67ecc8e2a8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.157630 Nov 19 19:32:32.982520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 634/1222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:32 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:32.993319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:32.994363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:33.000653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:33.001091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:33.001848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:33.002314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:33.031751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aaecd27c-1da8-4579-8cbf-a87ff279901a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042723 Nov 19 19:32:33.032319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 589/1223] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:33.079214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:33.079783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:33.086136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:33.086612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:33.087401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:33.088125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:33.173070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:33.173678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:33.180109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:33.180555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:33.181327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:33.182026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:33.236939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:33.246571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:33.248255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:33.250320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23ab8038-03d9-42cc-aca9-a80e497f6b43 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174238 Nov 19 19:32:33.250320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 635/1224] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:33.335405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:33.343765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cb73528b-198e-4149-8b6f-bd23d2d06cca tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.173992 Nov 19 19:32:33.344299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 590/1225] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:33.999278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:33.999860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:34.006571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.007020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.007814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.008243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.043851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:34.044906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:34.052069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.052520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.053292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.053714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.085684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-273a453b-75c2-4ff8-b514-65da5abc8ee6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Nov 19 19:32:34.086297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 591/1226] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:34.142238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:34.149723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e31927e8-a1c4-4162-b8a2-a267d96faaf5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.154714 Nov 19 19:32:34.150433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 636/1227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:33 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:34.268394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:34.269334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:34.276257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.276724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.277516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.277941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.361927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:34.362766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:34.369629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.370094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.370880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:34.371308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:34.439734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:34.448457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:34.449928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:34.451088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b35f86a-3068-4df9-8202-cc109e6ff50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186524 Nov 19 19:32:34.451629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 592/1228] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:34.518874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:34.526625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b09e20f-f9a7-4b7f-82fe-98afea35d493 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168412 Nov 19 19:32:34.527204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 637/1229] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:35.097224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:35.098188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:35.105166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.105609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.106423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.106853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.142436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-47232b22-55c3-408c-a084-fa22f98437a8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049202 Nov 19 19:32:35.143030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 593/1230] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:35.167476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:35.168095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:35.175314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.175763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.176556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.176991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.321105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:35.329851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-57323c5b-ee3c-4a3d-81ad-ce710d88a347 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.166515 Nov 19 19:32:35.330454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 638/1231] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:35 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:35.469398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:35.469902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:35.476425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.476886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.477639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.478265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.543953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:35.544663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:35.551656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.552181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.553024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:35.553460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:35.646897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:35.655979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:35.657458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:35.658875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b21eafd9-2f88-47fe-99eb-cd8bdc2edcc2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.193486 Nov 19 19:32:35.660060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 594/1232] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:35.716625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:35.725885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2dd52314-7ff2-4c4c-8e05-13bc9a5f3333 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.185706 Nov 19 19:32:35.726418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 639/1233] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:36.154797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:36.155762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:36.162932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.163361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.164235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.164665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.200854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5e97fd5d-8c52-45ea-b094-fad0d0ffe8ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049805 Nov 19 19:32:36.201438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 595/1234] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:36.347720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:36.348473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:36.356530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.356984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.357778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.358262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.676737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:36.677635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:36.684424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.684869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.685659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.686100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.742699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:36.750650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f608781b-3a23-4aaa-ae42-b30b7546c58c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.407130 Nov 19 19:32:36.751225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 640/1235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:36 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:36.755615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:36.756218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:36.762418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.762694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.764099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:36.764545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:36.861067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:36.869926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:36.871420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:36.872572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-75bcb65b-19ac-4e29-97dd-6ac70731ba1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.199606 Nov 19 19:32:36.873409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 596/1236] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:36.934760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:36.944823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d109971-d86b-4a1c-b5bd-f61780436819 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.192359 Nov 19 19:32:36.945448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 641/1237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:37.212261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:37.213292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:37.220584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.221059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.221792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.222275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.253245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8ea0253-50af-45e6-90da-2885220e0e07 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Nov 19 19:32:37.253904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 597/1238] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:37.768141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:37.768829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:37.775620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.776069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.776842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.777271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.890619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:37.891220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:37.897126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.897566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.898355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.898802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.915069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:37.922870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56e7e4db-5621-4a83-9143-0267f04948dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.158384 Nov 19 19:32:37.923434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 642/1239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:37 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:37.962730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:37.963365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:37.970179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.970627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:37.971409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:37.971824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:38.059569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:38.068125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:38.069639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:38.071361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ffd4b9c-221d-42e2-a3be-bfc2006290ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.184523 Nov 19 19:32:38.072024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 598/1240] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:38.131535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:38.139811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e4e2f356-3090-4bb3-9755-f997cd103106 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.181085 Nov 19 19:32:38.140378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 643/1241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:38.264972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:38.265881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:38.272717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:38.273164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:38.273945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:38.274412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:38.304779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c4a5eaf-98a9-44fa-b33b-e9a5fb60f015 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043558 Nov 19 19:32:38.305342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 599/1242] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:38.940238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:38.940811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:38.947877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:38.948328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:38.949116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:38.949547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.090272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:39.090918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:39.094012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:39.097605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:39.098068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.098866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:39.099268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.101462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f8e3a63a-36f2-406c-a976-a41a26110d77 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.165046 Nov 19 19:32:39.102076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 644/1243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:39.156664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:39.157276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:39.163499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:39.164068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.164883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:39.165311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.263448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:39.272671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:39.274359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:39.275979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1c366792-a95e-4f5f-9bcc-15a7a74d6043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.189544 Nov 19 19:32:39.276760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 600/1244] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:39.316707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:39.317590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:39.323972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:39.324421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.325202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:39.325624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:39.330857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:39.338802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b6a7eedc-744c-4e06-8d17-18e8209b3cc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.185767 Nov 19 19:32:39.339805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 645/1245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:39.356527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-acbce1fc-96b9-4bbe-985a-704aa54dccbc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Nov 19 19:32:39.357086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 601/1246] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:32:40.175870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:40.176449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:40.183412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.183857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.184658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.185088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.294782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:40.295444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:40.302318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.302747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.303507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.303937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.333140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:40.345570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e630b6ad-a223-4d53-953e-09e21ab47110 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.229923 Nov 19 19:32:40.346599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 646/1247] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:40.356774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:40.357499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:40.365328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.365767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.366730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.367161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.489333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:40.499579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:40.501106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:40.502332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0210576b-6aad-4f78-8c55-c1eea61cdaf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.211347 Nov 19 19:32:40.502868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 602/1248] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:40.507457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:40.508363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:40.514324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.514810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.515578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:40.516004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:40.538360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:40.546409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b51f38b-6cf6-444f-8333-b8d4545db6dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.193819 Nov 19 19:32:40.546957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 647/1249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:40.547702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c77cb2e-8501-4072-b4dd-c32aea4a55d1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Nov 19 19:32:40.548257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 603/1250] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:41.370909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:41.371510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:41.381153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.381805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.383045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.383680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.520969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:41.521514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:41.528373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.528816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.529577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.529970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.553347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:41.561359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-469aa7a9-eb67-4dc8-a2dc-2b92fc2b5a3b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.195359 Nov 19 19:32:41.561937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 648/1251] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:41 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:41.566316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:41.567298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:41.574530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.574988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.575782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.576228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.606751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-95cb5913-26e9-421a-b76a-1f6b3fb77d74 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043734 Nov 19 19:32:41.607312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 649/1252] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:41.611588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:41.612183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:41.617803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.618287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.619144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:41.619567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:41.671216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:41.679887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:41.681363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:41.682580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-89a8ef20-be0c-4d4a-9ace-ee2d1ae7a8ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.165552 Nov 19 19:32:41.683114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 604/1253] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:41.764685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:41.776275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3cd3c0f5-c969-4155-9414-8560e2b0fd7e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167907 Nov 19 19:32:41.776794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 650/1254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:42.580683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:42.581481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:42.589310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.589757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.590564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.590985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.619778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:42.620763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:42.627926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.628343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.629178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.629580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.665913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fdc78610-6801-4184-b76e-a3ddb9643dcf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050870 Nov 19 19:32:42.666773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 651/1255] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:42.701213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:42.701859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:42.708837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.709292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.710134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.710587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.903310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:42.912008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:42.913448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:42.914659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c2b6ccf1-5f9d-4b1e-9312-68bc8c1193c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.217596 Nov 19 19:32:42.925691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 652/1256] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:42.929373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:42.929961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:42.936268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.936708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.937486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:42.937626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:42.937906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:42.946082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4d6b99c5-bc32-4682-bfaf-ad7ea8822247 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.370506 Nov 19 19:32:42.946772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 605/1257] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:42 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:43.107891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:43.116087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e18a8975-6af2-408e-b998-6b1eb340244f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.199767 Nov 19 19:32:43.116797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 653/1258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:43.676935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:43.677867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:43.685137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:43.685585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:43.686414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:43.686837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:43.721573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9beb46c3-399f-4a4d-b7c5-719ecb106b9e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048419 Nov 19 19:32:43.722283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 606/1259] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:43.933853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:43.934520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:43.941365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:43.941857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:43.942735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:43.943193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:43.965089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:43.965956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:43.974202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:43.974807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:43.976093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:43.976816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:44.157037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:44.166812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:44.168679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:44.169969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aeff999a-d96c-4655-aeab-3e2508778c67 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.240234 Nov 19 19:32:44.170640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 654/1260] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:44.176143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:44.176928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:44.184916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:44.185626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:44.186913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:44.187598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:44.190029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:44.202829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d04dd869-c27a-4714-addb-2507ccecbce1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.242245 Nov 19 19:32:44.203790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 607/1261] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:43 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:44.344514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:44.355941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9da10d02-d7da-4641-8552-1308085bedfa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.183717 Nov 19 19:32:44.356910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 655/1262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:44.734311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:44.735329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:44.742543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:44.743034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:44.744205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:44.744910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:44.778603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-055834d6-97eb-4693-9f43-d6735b2b8270 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048161 Nov 19 19:32:44.779145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 608/1263] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:45.198900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:45.199748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:45.206809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.207369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.208271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.208806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.225327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:45.226191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:45.234526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.235166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.236071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.236598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.452438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:45.460259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:45.467896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:45.468786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5e7148b-18f8-4a33-9404-2563bd2d2665 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.247193 Nov 19 19:32:45.469339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 609/1264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:45 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:45.471457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:45.473591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b788e952-860c-4e8d-8a8b-326725cde242 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.278930 Nov 19 19:32:45.473803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:45.474316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:45.474935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 656/1265] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:45.485812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.486594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.487908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.488645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.654290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:45.667859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6cf1f794-a9b6-4310-86ae-e821581da8df tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.197133 Nov 19 19:32:45.668917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 610/1266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:45.791128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:45.792389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:45.803781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.804571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.805975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:45.806859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:45.862830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8a25d89f-9583-49d7-afb8-cfa65dcc68c4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075281 Nov 19 19:32:45.863815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 657/1267] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:32:46.490334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:46.491256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:46.493519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:46.494851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:46.498828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.498828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.499648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.500055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.506894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.506894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.507237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.507705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.737484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:46.746572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72c33205-efc6-456e-aab3-7d0fdc88517c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.260153 Nov 19 19:32:46.747025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:46.747399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 611/1268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:46 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:46.753856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:46.754581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:46.762972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:46.764999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.765765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.766156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:46.767320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.768025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.768576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6e8bddf4-42a2-4ff2-817c-5796d2bd444a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.279784 Nov 19 19:32:46.769571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 658/1269] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:46.878731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:46.879898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:46.887343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.888100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.888983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:46.889668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:46.942882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ac73e26-ab68-4637-a00d-29106247b0c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068868 Nov 19 19:32:46.943551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 659/1270] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:32:46.945459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:46.956177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-97401a1c-40d0-4f23-a831-08c0bd263f1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.207648 Nov 19 19:32:46.956967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 612/1271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:47.763943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:47.764610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:47.772158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:47.772666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:47.773509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:47.773956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:47.792846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:47.793923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:47.805681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:47.806557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:47.808081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:47.808834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:48.004102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:48.012980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d2ade174-9f6f-4627-bf1b-f76bd0da6df3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.252898 Nov 19 19:32:48.013609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 660/1272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:47 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:48.018284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:48.019238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:48.021663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:48.029527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:48.030318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:48.031791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:48.032424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:48.032703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:48.033925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:48.035306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62997077-210d-4c10-8e9e-dad5ff68ace4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.249822 Nov 19 19:32:48.035820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 613/1273] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:48.046111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:48.046111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:48.049649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:48.050118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:48.050934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:48.051401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:48.092060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96f8da85-6d27-4ef3-9085-3ed682210f20 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076869 Nov 19 19:32:48.093668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 661/1274] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:48.204308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:48.212709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-df6aa463-d2dc-43e9-bbf5-015d2815963a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.175786 Nov 19 19:32:48.222306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 614/1275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:49.034316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:49.035182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:49.043962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.044425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.045262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.045697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.056093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:49.059253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:49.067537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.067983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.068819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.069233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.334577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:49.362084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-794620ef-dcc6-400c-b063-7a31a8fef773 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.314390 Nov 19 19:32:49.362084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 662/1276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:49 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:49.362084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:49.362084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:49.362914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:49.363074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.363074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.363074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.363074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.369047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:49.371252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:49.372749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-990c6f7d-f02e-46a8-acb5-be8c2dd029e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.321155 Nov 19 19:32:49.373354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 615/1277] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:49.383422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:49.384419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:49.393804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.394290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.395088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:49.395521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:49.397011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e1aa0f78-b92c-4a03-8f37-7a1966799842 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051138 Nov 19 19:32:49.397599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 663/1278] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:49.579430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:49.594412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-93b6b3ca-ad46-4581-87b4-0435917dfe71 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.218941 Nov 19 19:32:49.595253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 616/1279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:50.371923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:50.372545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:50.379974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.380443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.381350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.381805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.403044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:50.403758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:50.413051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.413487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.414331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.414765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.619788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:50.627699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2bcf7ea8-72a4-44d2-ab42-b6dd38a66bd4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.260014 Nov 19 19:32:50.628290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 664/1280] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:50 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:50.632887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:50.633823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:50.640590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:50.641138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.641593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.642420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.642855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.657622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:50.661663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:50.664152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-826547d2-c029-4fa3-bf22-4dec9c41f8d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.264753 Nov 19 19:32:50.665361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 617/1281] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:50.674267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:50.675171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:50.684460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.684724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3fde5f2f-0910-4774-b252-05d12a8de1ee tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054950 Nov 19 19:32:50.685064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.685761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 665/1282] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:50.686159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:50.686736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:50.865374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:50.874300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2eb249e9-81bc-4291-a9ce-8073a6e2a1e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.207355 Nov 19 19:32:50.875065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 618/1283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:51.651627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:51.652293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:51.659139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.659586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.660346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.660868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.685423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:51.686221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:51.696381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.697888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.699018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.699713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.887729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:51.896518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81547220-3575-4ec5-9a8a-256f2f500b5a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.248975 Nov 19 19:32:51.897110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 666/1284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:51 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:51.902366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:51.903217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:51.909512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.910140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.910792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.911299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.915213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:51.932099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:51.933892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:51.935156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d51f4694-6cea-4f6e-8f7d-ae96e713571a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.254544 Nov 19 19:32:51.935730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 619/1285] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:51.940640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:51.941273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:51.944530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2faea6b1-4e85-4222-94c5-9057c64a1a78 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046337 Nov 19 19:32:51.950158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 667/1286] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:51.950436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.951220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:51.952384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:51.952939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:52.110622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:52.119029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-247af696-c4a6-4e9f-bb1d-1e6fcf102e88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.182215 Nov 19 19:32:52.119696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 620/1287] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:52.920176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:52.920918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:52.929636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:52.930248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:52.931278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:52.931823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:52.961016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:52.962070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:52.970362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:52.970733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:52.971375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:52.971796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:53.007285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ee91f89-0291-4d48-92fd-ad9899e3fa8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050114 Nov 19 19:32:53.007973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 621/1288] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:53.012882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:53.013488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:53.019932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:53.020418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:53.021211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:53.021685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:53.125879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:53.138977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eed9fdec-3d4e-4d9b-9b9c-f858a440ff90 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.223215 Nov 19 19:32:53.139713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 668/1289] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:52 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:53.145274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:53.146399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:53.159142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:53.160218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:53.161494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:53.162140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:53.243495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:53.253766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:53.255530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:53.256830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e4f040c-67f9-4ced-8af4-5885e8aa9916 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.247910 Nov 19 19:32:53.257705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 622/1290] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:53.349158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:53.358497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1bde84da-5551-457f-b8ff-f03ba7c17e60 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.217511 Nov 19 19:32:53.359088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 669/1291] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:54.021681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:54.022652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:54.030402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.030994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.032032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.032532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.069681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04041fbc-294b-4df7-8b46-6d2333a9165c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051854 Nov 19 19:32:54.070704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 623/1292] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:54.156907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:54.157518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:54.164432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.164886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.165685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.166151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.280967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:54.282320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:54.292390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.292933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.293888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.294514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.331240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:54.339933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab0a4ab4-00d1-4478-9a53-ca67b55c83fe tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.186630 Nov 19 19:32:54.340532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 670/1293] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:54 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:54.376894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:54.377566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:54.384557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.385006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.385881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:54.386386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:54.451133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:54.460826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:54.462517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:54.463795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-876a44b3-3fe0-4bfb-9dc9-602b995bd3ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191375 Nov 19 19:32:54.464397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 624/1294] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:54.551907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:54.564279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0a8b9094-e283-466f-9ff2-c3a0b2b16764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.191219 Nov 19 19:32:54.564876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 671/1295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:55.083577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:55.084611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:55.092513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.093321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.094219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.094661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.128534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b2d6346c-c599-4ce4-9704-b99be06bbcfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048633 Nov 19 19:32:55.129187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 625/1296] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:55.357921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:55.358579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:55.365643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.366118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.366912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.367345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.483602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:55.484223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:55.490862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.491415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.492228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.492672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.527937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:55.536239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a7b03e7-0339-4014-9533-145ea812e45a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.182350 Nov 19 19:32:55.536803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 672/1297] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:55 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:55.582191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:55.582805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:55.589506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.589990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.590836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:55.591342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:55.653334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:55.662573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:55.664278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:55.665934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-382c1a29-aa41-4161-9e43-d609ef67a368 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.185713 Nov 19 19:32:55.666546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 626/1298] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:55.754028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:55.762770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-97967f7c-8553-4cc1-9e5f-6f4d3e0a2ceb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.184196 Nov 19 19:32:55.763418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 673/1299] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:56.140878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:56.141961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:56.149157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.149842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.150874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.151309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.185544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-85e9a5db-fd56-4276-a0d1-e6fe16039b5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048581 Nov 19 19:32:56.186188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 627/1300] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:56.553978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:56.554655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:56.561383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.561770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.562605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.563045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.686272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:56.686909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:56.693270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.693671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.694499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.694966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.713650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:56.723215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59ea52c1-35ea-466d-bd2d-cc6d92ae9101 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173396 Nov 19 19:32:56.723958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 674/1301] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:56 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:56.781022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:56.781682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:56.789029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.789483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.790372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:56.790801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:56.874563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:56.883764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:56.885563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:56.886869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bda8189a-e175-4190-ad14-c4ebc0aad867 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.204662 Nov 19 19:32:56.887447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 628/1302] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:32:56.977536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:56.987097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8038cd8-0db4-4670-8948-7a33101aa699 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.209802 Nov 19 19:32:56.987758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 675/1303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:57.197403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:57.198354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:57.205076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:57.205545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:57.206353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:57.206781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:57.240483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95fac170-b0b8-4bca-9c7b-26e99b034525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047196 Nov 19 19:32:57.241134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 629/1304] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:57.744442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:57.745083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:57.751827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:57.752287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:57.753082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:57.753519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:57.911144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:57.911864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:57.919197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:57.919676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:57.920535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:57.920759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:57.921006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:57.930669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de3bf6c2-bade-48b8-99a9-d180da73e61c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.190204 Nov 19 19:32:57.931605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 676/1305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:58.006507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:58.007058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:58.014560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:58.015007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:58.015950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:58.016388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:58.078981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:58.088381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:58.090366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:58.091636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-486b0cab-1136-45b5-bd68-5c6cba7a9ad9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.185073 Nov 19 19:32:58.092219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 630/1306] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:58.201630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:58.210115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8076a7f-e8f0-4af6-a722-37ba4c167986 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.207866 Nov 19 19:32:58.210714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 677/1307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:32:58.254282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:58.255540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:58.263096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:58.263508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:58.264325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:58.264821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:58.295770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06f1cb61-f33a-4804-a936-a304415320c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046336 Nov 19 19:32:58.296304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 631/1308] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:58.953017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:58.953893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:58.962197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:58.962963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:58.963875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:58.964310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.111040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:59.111670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:59.118498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:59.119014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.119975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:59.120417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.124607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:59.134593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd67fa48-2975-4d03-941f-0ec671127c47 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.185029 Nov 19 19:32:59.135439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 678/1309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:32:59.231744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:59.232720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:59.241591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:59.242329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.243218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:59.243676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.285087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:59.295276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:59.296938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:59.298253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6bb0ae26-453a-44e6-80c8-462c228a9214 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191207 Nov 19 19:32:59.298877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 632/1310] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:32:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:32:59.307430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:32:59.308332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:32:59.314885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:59.315336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.316137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:32:59.316648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:32:59.351026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-78181fef-48c3-4be4-8554-102dcbd51764 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047672 Nov 19 19:32:59.351706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 633/1311] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:32:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:32:59.407179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:32:59.415595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ee244440-5f48-4430-a11d-89a530d418fb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.189031 Nov 19 19:32:59.416359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 679/1312] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:32:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:00.155758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:00.156439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:00.164329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.164811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.165903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.166610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.320623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:00.321949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:00.330440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.330891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.331707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.333303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.334998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:00.345869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39200e87-0470-41c5-b875-a61ef68b7e57 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.194357 Nov 19 19:33:00.346495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 634/1313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:00 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:00.363355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:00.364427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:00.371045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.371493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.372340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.372839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.404773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88c03a31-e22f-450c-b3b4-e095bbeaf9b8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Nov 19 19:33:00.405449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 635/1314] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:00.436271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:00.437069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:00.444003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.444450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.445270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:00.445685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:00.482093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:00.490832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:00.492379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:00.493991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c96d20c8-e31f-411a-b1e2-445244705825 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.178681 Nov 19 19:33:00.494547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 680/1315] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:33:00.587554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:00.595696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8483e4f-ef65-4c14-a983-113c49df317f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165478 Nov 19 19:33:00.596271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 636/1316] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:01.364699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:01.365370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:01.372619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.373075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.374007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.374513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.417430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:01.418516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:01.425459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.425910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.426755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.427225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.461098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9654cd1-68bf-4bda-b5f6-1b53365a9eec tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047951 Nov 19 19:33:01.461746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 637/1317] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:01.513566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:01.514190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:01.520508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.520951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.521740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.522204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.527313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:01.534978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f21844c-2c41-4246-8477-be1d6f308109 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.175137 Nov 19 19:33:01.535631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 681/1318] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:01 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:01.613188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:01.613778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:01.620841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.621464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.622413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:01.623040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:01.665931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:01.675207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:01.676795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:01.678171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4f2cbba-7ab0-40f4-b988-e6eb00c63229 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.169159 Nov 19 19:33:01.678777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 638/1319] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:33:01.775606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:01.784026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2289fdc-a2fb-4f80-ad03-2db5c3080ac0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.174744 Nov 19 19:33:01.784609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 682/1320] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:02.475046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:02.476044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:02.483171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.483660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.484515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.484960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.517598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-913d5218-9ad7-4d02-b49e-7c656572a9cf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046322 Nov 19 19:33:02.518277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 639/1321] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:02.553390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:02.554098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:02.562099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.562634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.563617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.564057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.698871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:02.699479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:02.707656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.708103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.708888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.709352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.728524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:02.741476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa688590-b38a-42ce-b84c-5271c6a7e488 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.191720 Nov 19 19:33:02.742515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 683/1322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:02 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:02.802178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:02.802799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:02.809758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.810387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.811550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:02.812223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:02.858929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:02.868635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:02.870315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:02.871711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cc66addb-7a70-4e79-83ff-2caaba44721e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.176867 Nov 19 19:33:02.872431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 640/1323] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:02.996369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:03.004529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd9f5359-2d90-4855-a773-7aa1fe2c552a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.206246 Nov 19 19:33:03.005119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 684/1324] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:03.530246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:03.531101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:03.538025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:03.538544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:03.539398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:03.539828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:03.570630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6dd89692-3076-4126-b1a6-40984a44e5a2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044678 Nov 19 19:33:03.571251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 641/1325] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:03.761549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:03.762363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:03.771972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:03.772570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:03.773755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:03.774555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:03.900038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:03.900711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:03.907612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:03.908077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:03.908905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:03.909382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:03.928445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:03.939631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c756a99-88a8-4d21-acdc-0b74507921d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.182523 Nov 19 19:33:03.940684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 685/1326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:04.026522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:04.027385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:04.036389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:04.037179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:04.038568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:04.039341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:04.071372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:04.080791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:04.082529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:04.083791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6a2f444-3725-4a6e-b595-adaf4ed47042 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.190434 Nov 19 19:33:04.084391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 642/1327] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:33:04.191734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:04.200378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c1c05a74-d38b-4540-b64f-06cb8f5c55cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.178849 Nov 19 19:33:04.200976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 686/1328] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:04.584405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:04.585711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:04.593459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:04.593925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:04.594724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:04.595190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:04.628114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4573b2d-cce6-4ee2-85a3-40ded736fef2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048684 Nov 19 19:33:04.628799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 643/1329] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:04.961560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:04.963883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:04.971950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:04.972395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:04.973260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:04.973741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.106471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:05.107495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:05.115328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:05.115879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.117720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:05.118423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.122815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:05.130527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1273c5d-114c-4bc8-a05d-9ffd3d2a1b3c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.174016 Nov 19 19:33:05.131144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 687/1330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:04 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:05.218878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:05.219493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:05.226340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:05.226827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.228221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:05.228716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.312104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:05.322343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:05.323978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:05.325582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a52663d5-f4f7-494a-a187-f88a328d6247 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.225000 Nov 19 19:33:05.326252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 644/1331] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:05.389647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:05.397412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cad5164c-5e45-47ee-b879-a1ff07ce79c9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.182491 Nov 19 19:33:05.397987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 688/1332] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:05.645362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:05.646914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:05.658363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:05.659314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.660790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:05.661787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:05.697459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0272d5b-b936-4f61-a430-5fc76fde0081 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059785 Nov 19 19:33:05.698308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 645/1333] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:06.149320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:06.150131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:06.157791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.158226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.159017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.159446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.337609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:06.346716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85bfece2-add7-4c7b-9436-4d6dd8c06227 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.201744 Nov 19 19:33:06.347304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 689/1334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:06.347449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:06.348289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:06.356589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.357190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.358142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.358929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.415662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:06.416282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:06.423211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.423645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.424451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.424929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.554511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:06.567482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:06.568607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:06.569851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c0085fdb-cf63-4558-8d65-d096cec696e1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.226779 Nov 19 19:33:06.570680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 646/1335] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:33:06.606806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:06.616173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ee2bfc85-2358-45ec-86db-e7c7f764a69b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.204377 Nov 19 19:33:06.616759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 690/1336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:06.708754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:06.709712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:06.717202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.717695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.718869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:06.719300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:06.761715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8da65e4c-be9f-40c9-8f2f-978303e19f3b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056739 Nov 19 19:33:06.762384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 647/1337] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:07.366886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:07.367560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:07.374965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.375444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.376290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.376780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.535090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:07.543954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-99fffa5e-3176-4a8d-be89-528fd427fcad tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.180949 Nov 19 19:33:07.544541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 691/1338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:07.589933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:07.590689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:07.597454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.598182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.598987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.599576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.635423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:07.636041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:07.642287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.642738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.643567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.644137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.793048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:07.803144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:07.805130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:07.806624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-14f7a08c-8fdf-4bb7-835e-00aebb580c5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.221043 Nov 19 19:33:07.807398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 648/1339] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:07.812438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:07.813362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:07.823822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.824539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.825466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:07.826196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:07.843517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:07.852158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-022c0c0a-d5c4-436f-92cc-cfc0febc8ce2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.221233 Nov 19 19:33:07.852806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 692/1340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:07.866216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b869dc1-9147-47a9-9cb0-284739bec2d0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057940 Nov 19 19:33:07.866813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 649/1341] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:08.562395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:08.563015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:08.569472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:08.569940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:08.570751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:08.571187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:08.726482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:08.737088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-272a2c14-e842-48d2-9a24-8bf537687ba6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.179084 Nov 19 19:33:08.737662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 693/1342] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:08.826216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:08.826855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:08.833553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:08.833999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:08.834796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:08.835225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:08.869602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:08.870244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:08.876697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:08.877147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:08.878288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:08.879103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:09.022198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:09.031369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:09.032828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:09.033972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f04fbb69-9b4b-47b5-8fec-45ffa396a49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.211744 Nov 19 19:33:09.034621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 650/1343] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:09.039267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:09.040480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:09.047350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:09.047867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:09.048721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:09.049154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:09.072350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:09.079755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2be77f89-3b7c-4a1f-8220-668deb508636 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044044 Nov 19 19:33:09.080006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-affa3200-b85f-4950-b1f4-d426e96cec87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.214348 Nov 19 19:33:09.080729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 651/1344] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:09.080882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 694/1345] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:09.756040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:09.756767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:09.764184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:09.764629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:09.765419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:09.765851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:09.902172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:09.909843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11ebbd6a-7b41-41e3-9fc5-1e58ed0726e3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.158660 Nov 19 19:33:09.910500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 652/1346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:10.052922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:10.053523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:10.060568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.061021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.061796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.062290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.091401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:10.092357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:10.099537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.099905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.100683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.101106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.130893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3f6467d0-5d55-45ef-9dee-80b84b037932 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Nov 19 19:33:10.131454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 653/1347] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:10.136098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:10.136781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:10.142470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.142910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.143674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.144097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.229506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:10.238252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:10.239741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:10.240910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14f667b3-24d9-4fbc-893e-d937bf511a00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191816 Nov 19 19:33:10.241510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 695/1348] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:10.298980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:10.307205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0abec9ab-a578-4f7e-bfa6-fb84b7d13deb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.174773 Nov 19 19:33:10.307768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 654/1349] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:10.932319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:10.932932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:10.940034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.940528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:10.941393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:10.941895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.085486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:11.093481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b8f44f6a-1874-4293-b842-5d3756bf6a9c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.165166 Nov 19 19:33:11.094063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 696/1350] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:10 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:11.143303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:11.144208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:11.150985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:11.151438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.152209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:11.152640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.182920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4a27d24-1e04-4161-9831-9e2894ab8ff4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043295 Nov 19 19:33:11.183396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 655/1351] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:11.259395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:11.260342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:11.267027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:11.267482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.268241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:11.268671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.325218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:11.325825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:11.332222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:11.332669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.333451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:11.333880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:11.431985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:11.440897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:11.442331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:11.443539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1703fb10-c332-414b-9756-9b58709a8624 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.187970 Nov 19 19:33:11.444025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 697/1352] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:11.496241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:11.504151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-454b19df-d9e7-4141-b915-7c5ce849cf3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.183011 Nov 19 19:33:11.504708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 656/1353] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:12.110637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:12.111241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:12.118455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.118927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.119840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.120283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.194811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:12.195934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:12.203539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.204078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.205195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.206406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.238822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e2734a1-e9d0-4c7d-b6de-d590eab498bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047909 Nov 19 19:33:12.239461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 657/1354] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:12.269195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:12.277633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8bf43ea-af09-42d1-810a-6d004bfd03c4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.170679 Nov 19 19:33:12.278255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 698/1355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:12 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:12.462507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:12.463026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:12.469887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.470340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.471116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.471544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.520803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:12.521518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:12.528186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.528641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.529432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:12.529867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:12.636331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:12.644960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:12.646476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:12.647821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d3707ef5-859a-4985-982d-5838009c1cf2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.189400 Nov 19 19:33:12.648192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 658/1356] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:12.920310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:12.929188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6fc1cde2-a484-41f0-9106-0913517224a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.412064 Nov 19 19:33:12.929850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 699/1357] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:13.250782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:13.251756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:13.258723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.259243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.260020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.260470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.291037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d92131a3-9047-40e6-ad91-a701df1cc27b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044111 Nov 19 19:33:13.291599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 659/1358] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:13.294858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:13.295498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:13.302367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.302801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.303600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.304030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.439541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:13.447522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e6502fe-48bb-4e9b-88a4-535b2e04a6ea tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.156461 Nov 19 19:33:13.448093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 700/1359] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:13 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:13.666452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:13.667059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:13.673366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.673818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.674632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.675069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.809765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:13.818715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:13.820178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:13.821337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-09acc781-15ea-4a67-bd1f-4d7d85dc6793 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.158730 Nov 19 19:33:13.821886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 660/1360] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:13.949519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:13.950149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:13.956607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.957050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:13.957825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:13.958291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:14.099146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:14.107674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d158408c-4dff-43ce-a257-6a26cee55e83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161885 Nov 19 19:33:14.108260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 701/1361] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:14.303632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:14.304462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:14.311403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:14.311854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:14.312760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:14.313193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:14.345127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6d731a9f-cd05-4c56-96b2-3a78a53a6e37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046447 Nov 19 19:33:14.345698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 661/1362] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:14.464845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:14.465443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:14.472880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:14.473323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:14.474155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:14.474585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:14.616385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:14.624766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34161ed8-6ff5-4dce-abe3-8118865c8c8b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163813 Nov 19 19:33:14.625356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 702/1363] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:14.839293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:14.839801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:14.846711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:14.847167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:14.847943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:14.848381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.000810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:15.009489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:15.011140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:15.012296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-48257daf-3439-4f27-bac4-22a763985143 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.176887 Nov 19 19:33:15.012848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 662/1364] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:15.125077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:15.125600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:15.132220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:15.132752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.133563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:15.133974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.274868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:15.283117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b8c0c726-6cef-481b-992b-bd7a270d7ed5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161825 Nov 19 19:33:15.283677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 703/1365] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:15.357144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:15.358087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:15.364802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:15.365246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.366011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:15.366465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.396705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3e319ea7-86c5-4008-898d-a8b22ad8a450 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043200 Nov 19 19:33:15.397187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 663/1366] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:15.641947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:15.642627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:15.649411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:15.649787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.650624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:15.651051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:15.793085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:15.800612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-131a3e6b-d38a-4b6e-a583-d01792fcc3de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162410 Nov 19 19:33:15.801196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 704/1367] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:15 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:16.030898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:16.031504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:16.039088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.039529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.040335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.040877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.173028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:16.181426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:16.183113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:16.184261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-636e275d-1f35-46cd-b698-6790fce671bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.157174 Nov 19 19:33:16.184848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 664/1368] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:16.300945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:16.301452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:16.308507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.308953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.309742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.310194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.408451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:16.409352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:16.415883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.416490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.417349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.417780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.446235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:16.448738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9725fe0e-6358-40d4-b412-7e27b90e50a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043835 Nov 19 19:33:16.449324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 665/1369] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:16.455065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a74f39af-721e-41c4-a8b8-460415fb1ad9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.157905 Nov 19 19:33:16.455633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 705/1370] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:16.816820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:16.817427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:16.826365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.826814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.827593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:16.828022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:16.980887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:16.991732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c1fe9fc6-c45b-4384-8398-7cadcdde7c67 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178500 Nov 19 19:33:16.992357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 666/1371] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:16 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:17.202590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:17.203177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:17.209976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:17.210477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:17.211265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:17.211701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:17.345719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:17.354989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:17.356478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:17.357649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4df65233-133e-433b-b87a-8a9a4d5145ac tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.158890 Nov 19 19:33:17.358229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 706/1372] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:17.460647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:17.461572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:17.468797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:17.469202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:17.470009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:17.470470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:17.479339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:17.480031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:17.486195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:17.486649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:17.487423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:17.487878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:17.501013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e684bb6-676c-4af0-b1a5-f025827182e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Nov 19 19:33:17.501572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 667/1373] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:17.624709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:17.632621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b047c790-7474-4d57-829e-0222513b4be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158789 Nov 19 19:33:17.633215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 707/1374] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:18.008870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:18.009508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:18.016466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.016914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.017704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.018176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.155846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:18.163719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-732c790e-57e1-4577-b508-65d1cd704da5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.158536 Nov 19 19:33:18.164237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 668/1375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:18.376673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:18.377299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:18.384191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.384646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.385619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.386087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.512765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:18.513813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:18.520539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.520988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.521780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.522233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.525049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:18.533784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:18.535328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:18.536489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f946a2d-43ed-47b3-94c0-cfc38e97cc6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.163666 Nov 19 19:33:18.537063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 708/1376] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:18.551530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-47bb07ec-0e7e-4110-b485-03b139baeb4e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Nov 19 19:33:18.552094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 669/1377] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:18.650226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:18.650812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:18.657286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.657734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.658542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:18.658965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:18.801574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:18.809909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0e92458a-0112-4f40-8079-db3c1fce059c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163371 Nov 19 19:33:18.810567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 709/1378] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:19.180434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:19.180943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:19.187414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.187850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.188627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.189056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.323990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:19.331876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-236133c5-1899-409e-93e4-296eab926c50 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.155171 Nov 19 19:33:19.332432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 670/1379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:19 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:19.555500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:19.556106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:19.563222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:19.564146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:19.564376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.564847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.565786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.566111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.571238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.571676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.572578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.573120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.606788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d647a4ee-1451-4eb8-abc4-3e662bcd9071 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047287 Nov 19 19:33:19.607380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 671/1380] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:19.719504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:19.730889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:19.732361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:19.733567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-814e2d9c-1049-428a-8e55-ecf9b9e86fb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.181898 Nov 19 19:33:19.734119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 710/1381] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:19.827548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:19.828033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:19.834653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.835098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.835880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:19.836307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:19.998909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:20.009290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a1e59114-7bc3-4aeb-86fd-02fcd746af77 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.185507 Nov 19 19:33:20.009931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 672/1382] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:20.349474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:20.350096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:20.356482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:20.356906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:20.357715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:20.358155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:20.507686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:20.516044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b96dd34b-8b13-44f0-947a-aa0954aa23ca tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.170197 Nov 19 19:33:20.517077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 711/1383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:20.617859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:20.618909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:20.625910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:20.626395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:20.627193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:20.627627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:20.660402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3aa1277f-d47b-427c-9a5f-50e02851835e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046391 Nov 19 19:33:20.660986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 673/1384] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:20.752182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:20.752806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:20.760104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:20.760443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:20.761260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:20.761695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:20.905030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:20.914474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:20.916170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:20.918118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-322e9047-ae05-4a6e-9306-8a6f1d44ffb7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.169547 Nov 19 19:33:20.919414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 712/1385] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:21.028222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:21.028724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:21.035089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.035532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.036323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.036757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.176455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:21.184211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b46138c-3514-4c47-a949-754dca9e2c16 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.159858 Nov 19 19:33:21.184801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 674/1386] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:21.533182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:21.533769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:21.540321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.540768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.541766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.542428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.673241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:21.674195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:21.680918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.681379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.683096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.683553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.695543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:21.708707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3cfcccb7-ca78-4bd5-a7f7-5d38bf743819 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.178836 Nov 19 19:33:21.709748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 713/1387] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:21 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:21.714086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bc1b5ba5-585d-45c2-a2d5-845d038b5f28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Nov 19 19:33:21.714667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 675/1388] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:21.938838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:21.939408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:21.945940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.946421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:21.947200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:21.947735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.090193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:22.100167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:22.101643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:22.102833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9dc02a25-1b79-4ce8-838b-bcf299d6de1b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.167880 Nov 19 19:33:22.103383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 714/1389] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:22.202588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:22.203108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:22.210104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:22.210586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.211382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:22.211818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.358913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:22.367171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c7ed72ae-87b4-4ed2-93cc-91327e8f354a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.169226 Nov 19 19:33:22.367768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 676/1390] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:22.727724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:22.728008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:22.728702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:22.728844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:22.735590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:22.735877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:22.736033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.736140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.736841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:22.737029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:22.737251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.737478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:22.770376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f434ff3d-1e29-4424-9a1e-50759ca0b045 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Nov 19 19:33:22.770847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 715/1391] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:22.878450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:22.886836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-22409f26-533f-4e4d-8daa-04819f48c5e0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162532 Nov 19 19:33:22.887381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 677/1392] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:22 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:23.121730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:23.122313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:23.129110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.129563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.130390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.130813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.284159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:23.293702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:23.295482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:23.296804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a8d4294-7a82-4233-9f64-2f2a4f12ad5a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.179064 Nov 19 19:33:23.297419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 716/1393] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:23.385430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:23.385992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:23.392716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.393237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.394035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.394508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.537336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:23.546684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7abc6fc8-75e3-49cc-af8b-eaa881e16aaf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165077 Nov 19 19:33:23.547268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 678/1394] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:23.782449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:23.783421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:23.790081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.790540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.791327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.791761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.824059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c012a8a7-c5ed-48b2-be17-7482d852b0c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Nov 19 19:33:23.824666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 717/1395] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:23.904954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:23.905669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:23.913592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.914093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:23.914892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:23.915347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.064913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:24.073798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bbd02504-81e6-4021-9945-01b6cbb62415 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173385 Nov 19 19:33:24.074430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 679/1396] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:24.316168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:24.316842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:24.324234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:24.324667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.325493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:24.325930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.477030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:24.487926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:24.489785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:24.491196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bdccc02e-1c03-4faa-9097-51cc6254087b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.178828 Nov 19 19:33:24.491798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 718/1397] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:24.564402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:24.565015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:24.571573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:24.571959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.573057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:24.573578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.724914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:24.732714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1f4228d-adbb-40cb-8d93-3d158129d6f8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.172025 Nov 19 19:33:24.733278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 680/1398] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:24.836494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:24.837518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:24.845181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:24.845667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.846632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:24.847126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:24.883081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7659d960-a3e6-4479-b60e-7ad809369bfc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050883 Nov 19 19:33:24.883738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 719/1399] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:25.091221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:25.091793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:25.099175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.099663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.100455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.100907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.261662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:25.273291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-21479a9d-14a7-47fb-ba65-2736fbdcb9b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.185924 Nov 19 19:33:25.273909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 681/1400] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:25 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:25.512627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:25.513424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:25.521107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.521598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.522450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.522906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.677012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:25.686816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:25.688475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:25.689714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1456c7e-22f9-4e05-99da-924266f65150 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.182193 Nov 19 19:33:25.690369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 720/1401] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:25.751743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:25.752402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:25.765778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.766356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.767428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.768098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.898982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:25.900082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:25.912740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.913586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.914914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:25.915357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:25.946157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:25.955448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da7c18ec-de3f-4ca9-93ba-c06680668c3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.208305 Nov 19 19:33:25.956441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 682/1402] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:25.971534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab94efec-75d5-4db7-b353-4cbffd5cf97e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077564 Nov 19 19:33:25.972239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 721/1403] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:26.292454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:26.293170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:26.299640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.300090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.300877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.301314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.466470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:26.475178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8bfdbd50-e3dd-4348-81c0-435b31b29935 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.189080 Nov 19 19:33:26.475762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 683/1404] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:26 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:26.711169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:26.711944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:26.720464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.721068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.721920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.722465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.875619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:26.886734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:26.888469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:26.889761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-db2454af-b561-494f-9f75-b9448d0ff04b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.183749 Nov 19 19:33:26.890379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 722/1405] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:26.980707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:26.981772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:26.986473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:26.987553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:26.988347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.988798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.989582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.990151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.996864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.997553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:26.998606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:26.999232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:27.043994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-baaec782-7e62-4090-bade-79158fba5f15 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061093 Nov 19 19:33:27.044664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 723/1406] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:27.170674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:27.180284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-00e232b0-7acd-4489-8298-05d31a88e192 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.204596 Nov 19 19:33:27.181006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 684/1407] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:27.495945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:27.496617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:27.505501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:27.506420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:27.507509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:27.508016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:27.677035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:27.687096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-36b826b5-cbc0-4197-8bd1-ede7dff00458 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.197356 Nov 19 19:33:27.687845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 724/1408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:27 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:27.914756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:27.915423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:27.923546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:27.924003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:27.924848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:27.925371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.056885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:28.059183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:28.066490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:28.067021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.067853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:28.068362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.087190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:28.097439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:28.099185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:28.100505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46db666d-afdc-4302-8208-df73048ecbab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191237 Nov 19 19:33:28.101303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 685/1409] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:28.103206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1f36fb58-b68c-47f2-bf33-d94e6e349ec8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050481 Nov 19 19:33:28.103781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 725/1410] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:28.199038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:28.199557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:28.206589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:28.207035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.207813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:28.208256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.378501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:28.386747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-36177002-ab72-4404-8554-fed2f7ccf97d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.191808 Nov 19 19:33:28.387341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 686/1411] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:28.706910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:28.707531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:28.715137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:28.715591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.716442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:28.716872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:28.869923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:28.878201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c70a1d69-7895-4b5c-b6ff-f113ae727cb3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.175068 Nov 19 19:33:28.879088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 726/1412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:28 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:29.116427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:29.117327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:29.124449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.125038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:29.125600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.125994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:29.126254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.126685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.134126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.134582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.135484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.136674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.164400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-30411c77-cac3-49c6-bbd4-4bdf261a030a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051382 Nov 19 19:33:29.165020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 687/1413] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:29.312594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:29.333955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:29.335586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:29.336775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aacf3d8f-f9d0-4a3b-a114-f11933811809 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.218839 Nov 19 19:33:29.337304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 727/1414] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:29.405396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:29.405877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:29.412729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.413233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.414247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.414780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.576732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:29.585207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5419da0c-8021-48f2-9004-6077fecae2f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.183748 Nov 19 19:33:29.585922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 688/1415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:29.897224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:29.898348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:29.908804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.909248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:29.910183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:29.910895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.067687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:30.077057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c698f30-b000-4d02-91ad-b1766a4c8966 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.184078 Nov 19 19:33:30.077649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 728/1416] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:30.177743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:30.178616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:30.186759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:30.187229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.188037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:30.188537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.225155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5766bb45-28e6-47ac-a12f-fdbd5a2d255c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051481 Nov 19 19:33:30.225734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 689/1417] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:30.358104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:30.358749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:30.366317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:30.366819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.367705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:30.368190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.537925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:30.548725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:30.550215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:30.551595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e7394d4-b2f5-4108-ac9b-b8ba19ac2ebe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.197649 Nov 19 19:33:30.552200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 729/1418] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:30.606395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:30.607472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:30.615033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:30.615624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.616403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:30.616828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:30.778735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:30.786679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0f9e7c5c-bb58-431c-b1e7-ad9e3dec87b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.185385 Nov 19 19:33:30.787271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 690/1419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:31.096520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:31.097130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:31.103373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.103824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.104857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.105458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.236940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:31.237904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:31.244994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.245795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.246733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.247260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.262859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:31.271873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9803356-b8b1-48f5-ba51-e7434f438743 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.179374 Nov 19 19:33:31.272811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 730/1420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:31.288176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-40b1dde2-040c-483b-93c9-8dd7f026ed55 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054668 Nov 19 19:33:31.290371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 691/1421] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:31.574134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:31.574889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:31.584198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.584825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.585944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.586715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.733772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:31.743284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:31.744971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:31.746251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d13c5d14-59ef-48e4-87b1-8edbec18707d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.178699 Nov 19 19:33:31.746930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 731/1422] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:31.804452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:31.805090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:31.812183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.812633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.813414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:31.813847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:31.971341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:31.981118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95ba8889-b6b2-47b3-a61b-495651252b0f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.180182 Nov 19 19:33:31.982149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 692/1423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:32.292790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:32.293505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:32.300267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:32.300703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:32.301442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:32.301870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:32.303738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:32.304721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:32.313408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:32.313872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:32.314700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:32.315137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:32.358215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8c53da07-6aaf-4a33-b788-ef489343943d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059346 Nov 19 19:33:32.359453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 693/1424] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:32.473449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:32.485981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1da1a0fe-8041-4555-b7d1-5a598c440d16 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.199177 Nov 19 19:33:32.487240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 732/1425] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:32 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:32.766782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:32.767393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:32.774697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:32.775271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:32.776248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:32.776720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:32.936573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:32.950879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:32.953648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:32.955887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d79492a-350c-45d1-b9c8-6fb052250cb2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.192662 Nov 19 19:33:32.956915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 694/1426] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:33.002410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:33.003727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:33.011672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.012289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.013308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.013820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.180553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:33.189550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a5a0d4b9-8a35-4033-bca5-494ad6a2e790 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.190967 Nov 19 19:33:33.190216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 733/1427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:33.372334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:33.373179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:33.380642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.381100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.381919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.382414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.417415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3ff26b05-c64e-4291-bc31-0198929901a1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049261 Nov 19 19:33:33.417986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 695/1428] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:33.506100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:33.506764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:33.514364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.514815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.515630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.516070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.662676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:33.670710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0284a592-36f6-4fe7-a30f-550f34e4a1a3 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168581 Nov 19 19:33:33.671309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 734/1429] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:33 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:33.985270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:33.985876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:33.992231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.992669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:33.993454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:33.993891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.131654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:34.141136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:34.142665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:34.143820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de739c95-dde3-451f-8cc4-71ad65a581db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162408 Nov 19 19:33:34.144378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 696/1430] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:34.207149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:34.207888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:34.214432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:34.214893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.215952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:34.216509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.357403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:34.365012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1dc0476e-a5ca-438d-b08e-cab712da2120 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161685 Nov 19 19:33:34.365602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 735/1431] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:34.429235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:34.430167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:34.437028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:34.437481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.438403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:34.438833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.469111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a305e7d-3af3-4329-bbe1-bfcfcc591e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043675 Nov 19 19:33:34.469656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 697/1432] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:34.687322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:34.688035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:34.694858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:34.695345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.696124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:34.696531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:34.834544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:34.843106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1857b5b-146d-4c62-a03e-f5c3b3fd9a36 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159121 Nov 19 19:33:34.843674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 736/1433] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:34 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:35.162971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:35.163655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:35.170404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.170855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.171643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.172077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.306990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:35.315971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:35.317436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:35.318642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e653ee46-6c94-4fb9-90f5-c255c241e751 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.159594 Nov 19 19:33:35.319176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 698/1434] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:35.382633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:35.383208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:35.389772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.390271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.391064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.391493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.480714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:35.481740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:35.488246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.488700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.489484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.489918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.519807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c652c50f-2d59-4ee8-be3d-cd8d72c8744b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042714 Nov 19 19:33:35.520387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 699/1435] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:35.540566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:35.548612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-125954c5-35f4-4fc5-a6e3-696b32aee2e3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.169690 Nov 19 19:33:35.549189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 737/1436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:35.860337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:35.860960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:35.867368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.867813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:35.868579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:35.869001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.023036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:36.032012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a3b135c9-8e3f-4d45-abfa-f3e641e6c1a2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.175356 Nov 19 19:33:36.032727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 700/1437] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:35 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:36.338332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:36.338969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:36.346711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:36.347163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.347947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:36.348380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.488965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:36.497534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:36.499059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:36.500228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e5d2834-6cd4-48de-a89e-047c3c7ee9f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.165746 Nov 19 19:33:36.500774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 738/1438] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:36.531352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:36.532340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:36.539038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:36.539500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.540268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:36.540699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.565567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:36.566190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:36.570958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ca700bd-7ca0-4da2-9e03-a48995849339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043618 Nov 19 19:33:36.571750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 701/1439] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:36.572457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:36.572903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.573737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:36.574215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:36.712369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:36.720711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c427ccd7-e191-4ffb-94f6-b91932795087 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158800 Nov 19 19:33:36.721286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 739/1440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:37.052069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:37.052674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:37.061570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.062090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.062941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.063462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.207730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:37.216388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6c798e4-dc1e-49d2-814c-d3453ee94eb9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168336 Nov 19 19:33:37.216977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 702/1441] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:37 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:37.518942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:37.519627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:37.526399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.526852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.527679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.528113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.583670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:37.584597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:37.591411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.591866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.593032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.593461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.629365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8734dcd1-816e-464b-81fe-f357b860750d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049534 Nov 19 19:33:37.629932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 703/1442] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:37.677266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:37.686728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:37.688211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:37.689445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c2bd0d4d-e73b-4d6e-b550-210325e89f71 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174314 Nov 19 19:33:37.690017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 740/1443] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:37.738010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:37.738669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:37.745260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.745714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.746754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:37.747183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:37.891846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:37.900209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72c47b17-4267-4059-a286-08907d46b52d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165866 Nov 19 19:33:37.900823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 704/1444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:38.234205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:38.234952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:38.241501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.241962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.242769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.243226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.378299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:38.386020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-58cbd882-f5b6-4427-8611-3bbd05277119 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.155815 Nov 19 19:33:38.386648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 741/1445] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:38.643844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:38.644853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:38.651799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.652282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.653238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.653613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.683475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-84e34c68-5d41-4339-8144-2b51a65547d5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Nov 19 19:33:38.684177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 705/1446] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:38.707842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:38.708409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:38.715409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.715866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.716648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.717078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.852839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:38.861799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:38.863302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:38.864457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e1765846-eada-4420-9ee4-ca3ea34a0bf5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.160399 Nov 19 19:33:38.865031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 742/1447] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:38.917204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:38.917788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:38.924888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.925339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:38.926216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:38.926676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:39.066193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:39.074136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6e5b482c-38cc-4b77-91fc-16079f656cb8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.160725 Nov 19 19:33:39.074980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 706/1448] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:39.402178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:39.402806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:39.409900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:39.410380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:39.411163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:39.411592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:39.557837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:39.565857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4768acb1-7256-4489-9e1f-d12fbb838b72 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.167400 Nov 19 19:33:39.566460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 743/1449] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:39 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:39.695139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:39.695904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:39.703020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:39.703469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:39.704241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:39.704665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:39.735216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-56744177-a802-44ad-a7db-3aabc8c5e1f3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Nov 19 19:33:39.735778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 707/1450] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:39.883927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:39.884510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:39.892349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:39.892349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:39.893002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:39.893435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.039063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:40.048089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:40.049558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:40.050754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-19c15602-0c8b-438d-a638-3e41dcbb428e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.171373 Nov 19 19:33:40.051316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 744/1451] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:40.091668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:40.092274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:40.098942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:40.099390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.100157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:40.100587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.240518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:40.250861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7fb15250-5abd-4668-9698-7e439d2bfc9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.162871 Nov 19 19:33:40.251424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 708/1452] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:40.583537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:40.584147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:40.591414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:40.591898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.593063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:40.593496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.735369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:40.743353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5957a97-7f2d-4f09-84b2-cc9c56975f06 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163502 Nov 19 19:33:40.744061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 745/1453] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:40.746845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:40.747759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:40.754332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:40.754770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.755523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:40.755949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:40.785474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0c326c66-a9b6-4b6c-bd63-069b7348df9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042599 Nov 19 19:33:40.786025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 709/1454] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:41.069626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:41.070233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:41.077561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.078015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.078835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.079269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.212165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:41.222988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:41.224506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:41.225672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dbab2bcd-7cdc-48f5-b6ee-42405a19c398 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.159980 Nov 19 19:33:41.226261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 746/1455] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:41.269402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:41.269953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:41.276843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.277396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.278264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.278780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.422655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:41.430774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-78b44e65-4e61-436d-8f7f-ef1578ad0c66 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165165 Nov 19 19:33:41.431316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 710/1456] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:41.760645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:41.761266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:41.768498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.768949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.769743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.770226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.797520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:41.798479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:41.805428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.807559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.808522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:41.808962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:41.841983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-530d1768-67bb-479a-bf92-39e1a9dca6ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048602 Nov 19 19:33:41.846319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 711/1457] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:41.917276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:41.926625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c4e31afe-1a33-4695-ae27-a6d7a0518811 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169570 Nov 19 19:33:41.927367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 747/1458] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:41 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:42.244899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:42.245506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:42.252566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.253034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.253826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.254613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.408613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:42.417691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:42.419216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:42.420408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bbf59abf-a688-4fec-b4f8-4d014de9a705 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.179467 Nov 19 19:33:42.421001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 712/1459] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:42.448730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:42.449400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:42.456116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.456537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.457314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.457738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.610271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:42.618340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34f5d1b5-47e0-4fac-be38-5e8629a49048 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.173232 Nov 19 19:33:42.619058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 748/1460] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:42.859601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:42.860491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:42.867258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.867677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.868457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.868880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.899463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-579df679-c416-4c6b-b13a-b51c29e6c254 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049038 Nov 19 19:33:42.900015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 713/1461] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:42.948280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:42.948898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:42.955689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.956139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:42.956934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:42.957369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.102768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:43.112378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-997394ee-00d1-4a84-8974-eb0569fbf3d1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169289 Nov 19 19:33:43.112887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 749/1462] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:42 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:43.439267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:43.439743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:43.446701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:43.447284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.448237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:43.449037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.598295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:43.607438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:43.608896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:43.610075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61734a05-de14-412c-97e6-b06bd98bfb2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174746 Nov 19 19:33:43.610625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 714/1463] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:43.636106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:43.636741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:43.643435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:43.643880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.644657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:43.645085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.790947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:43.801093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-01dc69ac-b707-4b5e-9ad4-76409e2a0dd0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168462 Nov 19 19:33:43.801917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 750/1464] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:43.912934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:43.913924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:43.921795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:43.922338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.923298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:43.923695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:43.959547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ab4fe3b7-8cfc-4e15-ac7c-a986391d8c9d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050458 Nov 19 19:33:43.960203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 715/1465] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:44.129657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:44.130225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:44.137127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.138401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.138555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.138955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.287740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:44.295639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fedfdc18-9722-4d03-8add-b13684214855 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169759 Nov 19 19:33:44.296197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 751/1466] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:44 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:44.629101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:44.629679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:44.637588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.638076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.639040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.639742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.783176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:44.792156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:44.794187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:44.795324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6e5f0454-d48f-4b4b-9723-c1407efb137b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.170333 Nov 19 19:33:44.795912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 716/1467] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:44.823639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:44.824904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:44.831496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.831941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.832720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.833140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.973010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:44.974830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:44.982387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.982854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.983699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:44.984111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:44.988026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:44.997633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fcdbbfe2-8ef0-4916-9bee-816961d287bb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.179658 Nov 19 19:33:44.998719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 752/1468] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:45.021269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4756bfcb-edff-4bb9-ab2a-9292172dbd33 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052314 Nov 19 19:33:45.021897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 717/1469] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:45.316183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:45.317125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:45.328078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:45.328992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:45.330398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:45.331151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:45.564717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:45.572483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b66c56a8-5f86-4dbe-8ce9-ce84de9c2540 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.262986 Nov 19 19:33:45.573053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 753/1470] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:45 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:45.814286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:45.814898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:45.821458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:45.821910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:45.822807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:45.823179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:45.973962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:45.989958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:45.991621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:45.993472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eeaf60b8-f1fd-4d40-bed0-93ac7d618a4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.182816 Nov 19 19:33:45.993863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 718/1471] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:46.019073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:46.019677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:46.026372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:46.026821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:46.027864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:46.028305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:46.038751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:46.040183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:46.049482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:46.049943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:46.050785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:46.051244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:46.089445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-887e26e6-1812-4640-a4c7-b6c66c7e641c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057218 Nov 19 19:33:46.090701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 719/1472] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:46.171958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:46.179871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-47309f82-7f2e-4ff2-97d5-4d2af1e7182b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.164503 Nov 19 19:33:46.180451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 754/1473] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:46.588892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:46.589497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:46.596460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:46.596906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:46.597674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:46.598140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:46.751229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:46.758877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cfd1eb21-df80-4cbd-8a28-b314cf14c78e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173665 Nov 19 19:33:46.759439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 720/1474] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:46 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:47.014435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:47.015212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:47.021824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.022987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.023159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.023526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.100917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:47.102773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:47.109584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.110034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.110850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.111314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.145605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c5c680a-35f6-462e-9e5a-3e56bea4f2c0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047351 Nov 19 19:33:47.145605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 721/1475] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:47.180841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:47.190166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:47.191648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:47.193185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-93e2abd8-4ead-4a7e-b0e3-5063b1f98399 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.183809 Nov 19 19:33:47.193709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 755/1476] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:47.197474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:47.198334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:47.205063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.205542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.206328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.206760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.352111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:47.360300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8baf6ad0-9fac-4d1b-8858-df6127ca06d1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166843 Nov 19 19:33:47.360865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 722/1477] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:47.776001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:47.776687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:47.783782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.784541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.785035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:47.785400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:47.927693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:47.936112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f1ae64c-0802-44bb-b183-da10913ce42b tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163822 Nov 19 19:33:47.936697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 756/1478] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:47 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:48.156375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:48.157249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:48.164494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.164951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.166021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.166586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.201332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6880ccc-5158-4b08-be07-7a6c040275fc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049189 Nov 19 19:33:48.201908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 723/1479] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:48.211536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:48.212197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:48.219422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.219869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.220680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.221109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.375578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:48.377730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:48.378370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:48.385556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.386023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.386894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.387321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.387440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:48.388846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:48.390287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a874b547-e40e-452a-84c6-c295412ab002 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.182508 Nov 19 19:33:48.390857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 757/1480] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:48.530243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:48.537910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0522b9ca-3b1d-4d9c-b9b4-4d2a5bb2406b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163826 Nov 19 19:33:48.538508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 724/1481] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:48.953411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:48.954143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:48.961194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.961646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:48.962475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:48.962918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.110984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:49.118773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-094e1614-515b-41bb-accc-5dd9e153d05a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.169227 Nov 19 19:33:49.119342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 758/1482] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:48 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:49.212895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:49.213837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:49.227503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:49.227945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.228750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:49.229605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.263747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ae4a3ac-e0f2-48a7-9957-fd66978d6d43 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054585 Nov 19 19:33:49.264317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 725/1483] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:49.409160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:49.409871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:49.416427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:49.416901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.417836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:49.418318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.555273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:49.555440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:49.555869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:49.561919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:49.562400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.563180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:49.563606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:49.564300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:49.565786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:49.566977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e2bf85c-3520-4f5f-ad8f-feeb9ee2e780 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.161772 Nov 19 19:33:49.567559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 759/1484] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:49.701443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:49.709253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-803c2bd7-cfdb-48f7-979c-f83cce8d29b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.157770 Nov 19 19:33:49.709792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 726/1485] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:50.136124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:50.136818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:50.143232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.143679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.144462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.144889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.275949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:50.276867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:50.284068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.284552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.285344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.285779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.290589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:50.300859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9fe556f3-3c8f-4ad5-a0ba-f076bbd940e7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168258 Nov 19 19:33:50.301566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 760/1486] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:50 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:50.327221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5569a19-5473-4b8a-8035-d2cf3f532bc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055043 Nov 19 19:33:50.327800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 727/1487] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:50.585950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:50.586819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:50.594196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.594621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.595440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.595874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.727468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:50.728077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:50.734570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.735004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.735466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:50.735805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:50.736238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:50.744245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:50.745727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:50.746928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9d8eb938-0b5f-4c0d-ac5c-47e8c368add9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164861 Nov 19 19:33:50.747476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 761/1488] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:50.888000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:50.896023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0ac2830-0f5c-47ca-9322-c8b2df5295ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.172337 Nov 19 19:33:50.896583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 728/1489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:51.325916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:51.326552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:51.334642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.335405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.336738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.337485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.339216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:51.340264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:51.348279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.348732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.349729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.350358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.383019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba19666a-8224-4b45-b142-1a44535de47e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047639 Nov 19 19:33:51.383594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 729/1490] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:51.495263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:51.506877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ea6862c5-d3d1-45e5-bec4-de6688a4219f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.184790 Nov 19 19:33:51.507806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 762/1491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:51 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:51.771126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:51.772104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:51.782484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.783296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.784661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.785427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.912710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:51.913361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:51.920550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.920977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:51.922218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:51.922985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:52.190451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:52.199306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:52.200778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:52.201944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-25b69a2a-b950-40e4-b3b5-a7d085b88bcb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.437976 Nov 19 19:33:52.212681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 730/1492] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:52.259023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:52.267425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd8f9f16-260b-4795-81e8-91eef3552405 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.358418 Nov 19 19:33:52.268024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 763/1493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:52.396036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:52.396971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:52.403959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:52.404411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:52.405204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:52.405635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:52.437251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d769913f-f3de-4e34-852f-65afe0f9330d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Nov 19 19:33:52.437789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 731/1494] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:52.524787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:52.525401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:52.531995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:52.532472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:52.533235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:52.533673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:52.676420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:52.684626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d021e9ee-2554-40f4-a4b0-6ba31712bb39 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163523 Nov 19 19:33:52.685191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 764/1495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:52 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:53.220855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:53.221458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:53.227875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.228326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.229096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.229529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.284629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:53.285232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:53.291695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.292148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.293665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.294132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.391932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:53.400848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:53.402476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:53.403622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4de14082-f748-401f-818a-d842f88400a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186925 Nov 19 19:33:53.404144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 732/1496] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:53.450596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:53.451854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:53.459508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.460130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.460682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:53.461261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.461819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.468789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-28147601-58f0-4155-91c7-cd674ea07e56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.187768 Nov 19 19:33:53.469354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 765/1497] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:53.494349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e5932d4f-7104-44fd-9dea-fda70d8d749d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049040 Nov 19 19:33:53.494913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 733/1498] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:53.701725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:53.702354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:53.708840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.709286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.710087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:53.710519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:53.856218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:53.863647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-496ccfa5-9943-41ec-bdaa-b25b5567b782 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.165645 Nov 19 19:33:53.864214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 766/1499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:53 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:54.422612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:54.423186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:54.429726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.430217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.430990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.431416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.486229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:54.486977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:54.493584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.494039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.494876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.495318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.593224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:54.601917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:54.603476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:54.604644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad3e7730-456e-42e8-8bf1-81f0119c3b0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.185774 Nov 19 19:33:54.605621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 734/1500] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:54.610031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:54.611038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:54.617078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.617525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.618340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.618770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.648696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-df4bc83d-10d7-4069-bdfb-ff2dc53d3de2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041936 Nov 19 19:33:54.649221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 735/1501] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:54.665565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:54.673806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3628fdaa-9805-4e31-84c0-51b5df77ae3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.191513 Nov 19 19:33:54.674419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 767/1502] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:54.882253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:54.883075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:54.890943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.891456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:54.892289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:54.892695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.036079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:55.045491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d61eca3a-0243-43c8-9db1-75c6945c2572 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168113 Nov 19 19:33:55.046083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 736/1503] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:54 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:55.630800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:55.631386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:55.640024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:55.640442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.641255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:55.641682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.661880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:55.662886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:55.670237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:55.670731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.671510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:55.671935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.703777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af40c3b6-4dcd-4c32-b095-668c953e7927 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046355 Nov 19 19:33:55.704376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 737/1504] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:33:55.710672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:55.711305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:55.718799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:55.719245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.720036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:55.720466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:55.806704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:55.815947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:55.817440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:55.818682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b579bb1d-8f00-4b96-b4bc-db868cfcaaad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.191753 Nov 19 19:33:55.819222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 768/1505] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:55.887146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:55.895354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-59354771-07a0-4146-b812-1b1696658def tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.189934 Nov 19 19:33:55.895913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 738/1506] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:56.063908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:56.064525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:56.070841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.071288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.072073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.072506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.220501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:56.228020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8d0b626-a8f2-4bdb-bcaa-96cc69def5ed tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168605 Nov 19 19:33:56.228617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 769/1507] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:56 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:56.510782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:33:56.511196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:33:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:33:56.716251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:56.717190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:56.724317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.724766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.725549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.726002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.755803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-30f8ccbd-0ab1-4324-9c95-56c72cd6e525 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Nov 19 19:33:56.756348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 739/1508] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:56.840442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:56.841092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:56.848103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.848544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.849341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.849768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.913447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:56.914072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:56.922479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.922944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:56.923811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:56.924218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:57.047047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:57.056900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:57.058522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:57.060395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b000595-3c5d-434c-bc14-31f1e8a13215 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.223848 Nov 19 19:33:57.060965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 770/1509] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:57.097447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:57.105171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe2edcd8-fd9d-4f23-b8fb-423f465d72b5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.195552 Nov 19 19:33:57.105706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 740/1510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:57.244629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:57.245205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:57.252019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:57.252465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:57.253673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:57.253673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:57.397001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:57.405340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab9b0cdf-07f8-4290-ae2c-bcdc6c5349b0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.164387 Nov 19 19:33:57.405918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 771/1511] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:57.768538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:57.769444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:57.775901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:57.776333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:57.777163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:57.777534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:57.807351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-165cfb12-40e2-4d0f-bf15-d082b3a84ec5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 Nov 19 19:33:57.807909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 741/1512] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:58.079711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:58.080266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:58.087126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.087582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.088359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.088793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.122272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:58.123007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:58.129346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.129791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.130632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.131056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.273600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:58.283278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:58.284867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:58.286236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a15bd53d-ec7a-4486-9455-4dd468fde0e4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.210733 Nov 19 19:33:58.286905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 772/1513] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:58.319214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:58.327285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43872a91-f4e9-4669-814b-03a52628c4b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.208726 Nov 19 19:33:58.327863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 742/1514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:58.422906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:58.423411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:58.429932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.430387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.431172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.431601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.571922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:58.580761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-277d9571-7a32-429a-8a3f-a2ba66e6962d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.161669 Nov 19 19:33:58.581308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 773/1515] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:58.819428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:58.820379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:58.827443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.827894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.828678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:58.829112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:58.861103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-02105506-48cb-403e-a23b-39639211fa84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Nov 19 19:33:58.861682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 743/1516] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:33:59.305026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:59.305615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:59.312488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.312939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.313707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.314251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.346962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:59.346962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:59.352845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.353272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.354076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.354518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.488718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:59.499157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:59.500624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:59.501805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e8b1fd3-5cfa-456c-9926-6cd50fe104cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.200563 Nov 19 19:33:59.502468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 774/1517] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:33:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:33:59.537587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:59.545336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-05b2643f-d342-4c6a-b0d1-ea0c2defb5fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.204324 Nov 19 19:33:59.545879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 744/1518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:33:59.598545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:59.599153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:59.605641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.606261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.607137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.607580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.751368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:33:59.759315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eb3c499a-7c7c-4739-a2b9-f7b02a3b3c45 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.164548 Nov 19 19:33:59.759887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 775/1519] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:33:59 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:33:59.873014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:33:59.873874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:33:59.880518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.880971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.881765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:33:59.882248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:33:59.913281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ce435a5-68e9-42f5-8c21-6ca905d10333 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044168 Nov 19 19:33:59.913863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 745/1520] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:33:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:00.520296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:00.520851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:00.528925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.529411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.530289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.530836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.562284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:00.562890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:00.569261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.569716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.570539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.570980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.709563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:00.719567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:00.721041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:00.722261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-da44e661-b506-448f-847b-9dc3c2613c7c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.205844 Nov 19 19:34:00.722828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 776/1521] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:00.757718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:00.765950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4f81abe-06dc-40bd-b514-90b7beb4f80e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.207516 Nov 19 19:34:00.766546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 746/1522] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:00.776561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:00.777093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:00.787679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.788237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.789320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.789824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.924963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:00.925878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:00.932582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.933037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.933942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:00.934391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:00.939761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:00.947899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5111b816-c883-444d-922c-86042998d947 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.175070 Nov 19 19:34:00.948457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 777/1523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:00 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:00.965824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1570f267-6984-4b89-9258-d8ff5e97747c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Nov 19 19:34:00.966449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 747/1524] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:01.741112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:01.741721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:01.749198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.749723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.750580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.751157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.788562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:01.789172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:01.796219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.796659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.797443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.797869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.925957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:01.935654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:01.937167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:01.938418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d4856e45-b0f8-47c9-8068-9ba4c0c5cdd4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.201307 Nov 19 19:34:01.938978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 778/1525] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:01.964974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:01.965609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:01.974543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.975035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.975372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:01.975840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.976269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.983980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2c9f2ebc-f101-47bb-8434-2d5f8835c681 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.204334 Nov 19 19:34:01.984559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 748/1526] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:01.988992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:01.989865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:01.997004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.997389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:01.998359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:01.998805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:02.030344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c072d423-fe48-4466-adc0-cc5d793fbf35 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044529 Nov 19 19:34:02.030782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 749/1527] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:02.120504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:02.128367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-45f6930d-f7c7-4459-a9ea-94d8b34354f7 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.167307 Nov 19 19:34:02.128942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 779/1528] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:01 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:02.957130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:02.957606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:02.964404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:02.964886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:02.965680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:02.966149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.000989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:03.001622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:03.008992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:03.009550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.010448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:03.010983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.140520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:03.149807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:03.151309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:03.153045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ddfa3be-852d-480a-9483-5ee0fea97fea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.199233 Nov 19 19:34:03.153186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 750/1529] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:03.157465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:03.158382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:03.170728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:03.171378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.171985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:03.172470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.206243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:03.207246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ceda58ce-dae0-4f0e-8088-9853f4b8403f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053058 Nov 19 19:34:03.210810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 751/1530] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:03.215537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:03.216390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:03.218972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ebf9b74-2734-46c5-82a1-c56a5960cbbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.221614 Nov 19 19:34:03.219716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 780/1531] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:03.222766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:03.223211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.223993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:03.224431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:03.364163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:03.372446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6098318-bf81-4365-bfcb-bfad357c2689 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.160853 Nov 19 19:34:03.373006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 752/1532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:04.177121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:04.178238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:04.187535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.187991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.188792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.189257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.219191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:04.220153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:04.226888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.227335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.228139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.228561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.260007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d7a821f-a541-42b4-8a2d-c02dc4aed172 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044946 Nov 19 19:34:04.260620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 753/1533] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:04.265594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:04.266231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:04.272146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.272591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.273455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.273793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.354634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:04.363898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:04.365404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:04.366671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46e44ddf-a256-4e4a-9e75-190fd5387bc4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.195831 Nov 19 19:34:04.367222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 781/1534] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:04.388824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:04.389412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:04.395778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.396240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.397034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:04.397472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:04.429393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:04.437429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b22c482c-e978-45f7-ad60-44c10cd89cce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.175805 Nov 19 19:34:04.438030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 754/1535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:04.531774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:04.540169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-931cda3e-280b-4d3d-a8a7-398082a6a778 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.154847 Nov 19 19:34:04.540740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 782/1536] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:04 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:05.272186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:05.273100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:05.279894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.280364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.281140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.281568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.313206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9e7708ae-d71d-47cf-a8a9-be5a2905df1c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044810 Nov 19 19:34:05.313765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 755/1537] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:05.384676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:05.385288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:05.392075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.392549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.393319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.393778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.455156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:05.455773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:05.461948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.462430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.463247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.463680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.561360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:05.570826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:05.572331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:05.573502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-116583e4-f3d7-45f7-916a-b4380f76c6ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.192667 Nov 19 19:34:05.574182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 783/1538] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:05.578446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:05.579052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:05.585333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.585791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.586633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:05.587071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:05.640591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:05.648231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5de118fd-9560-41d6-91f6-6ba049c44d78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.196797 Nov 19 19:34:05.648798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 756/1539] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:05.740909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:05.748778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84ea116e-a5b8-47a6-99a4-35ebe36ab03d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173607 Nov 19 19:34:05.749350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 784/1540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:05 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:06.325148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:06.326079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:06.332839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.333284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.334039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.334511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.365137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d980b917-a072-4413-8b33-1b554ee48bc1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Nov 19 19:34:06.365684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 757/1541] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:06.592644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:06.593324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:06.600038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.600502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.601299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.601780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.665945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:06.666761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:06.674140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.674726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.676358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.676799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.767966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:06.779270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:06.780783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:06.781984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6c75feb-04e3-4383-b4bd-6f4b2a5b466e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.193591 Nov 19 19:34:06.782578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 785/1542] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:06.786876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:06.787499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:06.794528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.794903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.795705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:06.796141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:06.845883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:06.853624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-487563d7-08e1-4e59-90d0-25fef297701c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.191436 Nov 19 19:34:06.854220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 758/1543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:06.940175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:06.948035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4dea644c-fd69-49ba-a778-f93eec815def tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.164429 Nov 19 19:34:06.948610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 786/1544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:07.377131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:07.378083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:07.384872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.385326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.386136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.386694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.416978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0f3fb08e-b17f-490c-a9f7-c91571581216 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Nov 19 19:34:07.417530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 759/1545] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:07.800212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:07.800829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:07.807729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.808215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.809087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.809521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.870571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:07.871510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:07.877815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.878316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.879106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.879515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.972939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:07.982086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:07.983697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:07.984868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a4005f8b-c3e6-4a9d-b001-aed9760a1d2d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.188476 Nov 19 19:34:07.985569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 787/1546] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:07.989742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:07.990368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:07.997833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.998313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:07.999102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:07.999534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:08.052298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:08.060394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f050edf1-a305-4eb1-a038-5e0ad6c8ca68 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.193452 Nov 19 19:34:08.060984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 760/1547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:08.152534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:08.160204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-58abfd79-9368-4edf-b88a-edba6abbf0c0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173845 Nov 19 19:34:08.160776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 788/1548] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:08.429046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:08.429860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:08.437210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:08.437664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:08.438502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:08.438937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:08.469713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b85cf3da-9f42-4d54-8200-86a847f39ab3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044548 Nov 19 19:34:08.470307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 761/1549] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:09.003463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:09.004054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:09.010716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.011164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.012444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.012892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.076892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:09.077487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:09.083803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.084269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.085049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.085477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.187007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:09.195694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:09.197261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:09.198399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9a3bbb9d-abfd-409b-bfd8-0856ef3c86ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.198825 Nov 19 19:34:09.199217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 789/1550] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:09.203634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:09.204330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:09.211767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.212220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.213019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.213456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.273739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:09.281481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4281c3a-c424-418d-a53e-e0ba371983b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.208420 Nov 19 19:34:09.282087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 762/1551] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:09.366006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:09.373676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-06aa41b8-9eb1-4669-bc60-15ca687723bd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.173470 Nov 19 19:34:09.374272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 790/1552] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:09.402989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:34:09.402989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:34:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:34:09.481432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:09.482446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:09.490273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.490726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.491644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:09.492141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:09.526127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f775abe8-561c-44ba-b2b8-a2d8ac1a1988 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048666 Nov 19 19:34:09.526699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 763/1553] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:09.683592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:34:09.683885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:34:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:34:10.216879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:10.222412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:10.229712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.230240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.231031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.231457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.300958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:10.301562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:10.308159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.308705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.309510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.309938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.406235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:10.415415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:10.416895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:10.418281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c8fd0fcc-4d3c-495f-b2cd-60081fc71b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.205077 Nov 19 19:34:10.418663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 791/1554] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:10.423852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:10.423852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:10.430223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.430669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.431469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.431904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.489723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:10.498067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b5472ae4-4880-42fb-a605-2d2660e10555 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.200723 Nov 19 19:34:10.498647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 764/1555] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:10.539079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:10.540039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:10.546446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.546891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.547792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:10.548488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:10.584281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0afc0bc2-2539-4a0e-b119-6bf2da17426b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048973 Nov 19 19:34:10.585183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 765/1556] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:10.597111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:10.604898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20007c5c-5e86-4bc5-b882-ed5c22200ddb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.185262 Nov 19 19:34:10.605468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 792/1557] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:10 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:11.436863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:11.437480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:11.444219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.444673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.445456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.445884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.523977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:11.524570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:11.531770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.532227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.532997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.533421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.630943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:11.640691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:11.642228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:11.643397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4041cf20-1a66-4d01-a2b9-51f4b10d20b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.210342 Nov 19 19:34:11.643920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 766/1558] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:11.648389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:11.649391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:11.656307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.656752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.657539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.658095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.690577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b3fce9a-1dd8-4afe-926c-b188a5f4596e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Nov 19 19:34:11.691177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 767/1559] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:11.695517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:11.696109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:11.702382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.702855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.703636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:11.704064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:11.707369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:11.715471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-049f6f0b-f943-42d6-b3eb-dcb3b58bb828 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.195247 Nov 19 19:34:11.716057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 793/1560] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:11.847893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:11.856248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c4f35412-4572-4aac-a046-0a19619a4555 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163391 Nov 19 19:34:11.856844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 768/1561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:11 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:12.662769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:12.663453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:12.670452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.670906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.671704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.672143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.702739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:12.703650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:12.710771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.711304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.712168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.712598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.744244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9084618f-bcd9-4008-b45d-8fa7a320ae97 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Nov 19 19:34:12.745008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 769/1562] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:12.749399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:12.749998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:12.756581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.757503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.757803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.758887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.835573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:12.844570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:12.846082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:12.847229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e3ace41-5a23-4a91-9bcf-4bc223b2c3f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.188270 Nov 19 19:34:12.847794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 794/1563] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:12.872905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:12.873521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:12.879427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.879869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.880650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:12.881082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:12.907576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:12.915211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5ce5aeb-3baa-492a-9919-5224767f99b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.169457 Nov 19 19:34:12.915769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 770/1564] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:13.020604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:13.028840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96e694b5-9b93-46cb-8dae-310b568d3cbb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159967 Nov 19 19:34:13.029425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 795/1565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:12 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:13.756017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:13.756932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:13.764078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:13.764597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:13.765316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:13.765748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:13.799307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ec1641c-0879-4b6f-a497-a0098bdc052f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047114 Nov 19 19:34:13.799870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 771/1566] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:13.866036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:13.866649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:13.873527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:13.873986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:13.874787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:13.875215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:13.932880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:13.933791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:13.940514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:13.940938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:13.941718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:13.942177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:14.052583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:14.063329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:14.065376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:14.066767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8de907b2-5912-4788-a47e-0490a56e997c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.204569 Nov 19 19:34:14.067539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 796/1567] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:14.075752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:14.076854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:14.087913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:14.088573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:14.089670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:14.090294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:14.126671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:14.134734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04ae195e-d497-4ac4-a3b6-4051149154fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.205489 Nov 19 19:34:14.135395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 772/1568] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:14.242027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:14.252081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e68c6d4c-2b7a-4610-aaad-db3c3156b8c1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.183140 Nov 19 19:34:14.252690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 797/1569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:14.810951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:14.811799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:14.818421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:14.818869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:14.819643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:14.820069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:14.851737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7665f0b0-8775-417c-bedd-70a7a54225c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Nov 19 19:34:14.852294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 773/1570] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:15.096139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:15.096709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:15.109420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.109871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.110683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.111117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.152217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:15.152837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:15.160454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.160910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.161675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.162163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.292278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:15.301914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:15.303414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:15.305181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f0a0901e-f24f-4fc5-8d5e-49823b8bf259 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.212802 Nov 19 19:34:15.305181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 798/1571] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:15.309567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:15.310233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:15.317016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.317444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.318264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.318695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.345014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:15.353461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-780a7f60-4235-400d-9630-c1ec9eba56ec tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.204756 Nov 19 19:34:15.353865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 774/1572] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:15.461018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:15.469185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9eb57a5-f3db-47f0-ad9d-63780fb660cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163005 Nov 19 19:34:15.469753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 799/1573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:15 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:15.863743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:15.864659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:15.871519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.872078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.872887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:15.873307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:15.908252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6feec151-ec56-4cc0-9b4a-f18f4ac654c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048234 Nov 19 19:34:15.908813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 775/1574] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:16.323503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:16.324414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:16.331328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.331762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.332521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.332951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.370642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:16.371259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:16.377598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.378386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.379181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.379619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.517666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:16.526402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:16.528000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:16.529168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-025ccc17-51dc-40b2-bb82-7ccb10e635bd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.209418 Nov 19 19:34:16.529725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 800/1575] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:16.534029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:16.534663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:16.540585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.541053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.541830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.542309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.570563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:16.578599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f841b006-a8e7-4767-a24b-dc41edc6237f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.211531 Nov 19 19:34:16.579160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 776/1576] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:16.685294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:16.693230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b2c3f43b-497f-4945-bda9-71d68c15759c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162454 Nov 19 19:34:16.693803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 801/1577] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:16 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:16.920816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:16.921636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:16.928458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.928898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.929672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:16.930102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:16.960687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-820addb7-0487-4ad9-a605-a5eef6fcad48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Nov 19 19:34:16.961243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 777/1578] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:17.548250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:17.548859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:17.555797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.556243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.557036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.557477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.596115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:17.596731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:17.606107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.606881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.608109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.608824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.733963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:17.743464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:17.744892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:17.746867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8aa5c550-cf68-4992-b96a-ae34456127f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.202966 Nov 19 19:34:17.747439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 802/1579] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:17.751881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:17.752485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:17.762185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.763001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.764412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.765191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.814798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:17.823093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46ea57f2-1159-4ccd-9a6f-a6081baec9e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.230885 Nov 19 19:34:17.823773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 778/1580] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:17.922947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:17.931165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e7af8cc-5e0a-4a13-82ba-33466a6ddb0a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.182602 Nov 19 19:34:17.931743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 803/1581] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:17 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:17.973426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:17.974414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:17.982065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.982541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:17.983366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:17.983813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:18.018522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-475eb2f3-7b71-42b2-9c91-d27fe143fd86 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048959 Nov 19 19:34:18.019065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 779/1582] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:18.771478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:18.772096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:18.779244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:18.779688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:18.780493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:18.780932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:18.844836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:18.845455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:18.853766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:18.854347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:18.855747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:18.856529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:18.979200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:18.990935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:18.992904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:18.994190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b7798a6f-af1c-4ca5-ab24-9166c176a7d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.226543 Nov 19 19:34:18.994782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 804/1583] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:34:18.999908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:19.000581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:19.008932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:19.009429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:19.010243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:19.010690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:19.137014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:19.145878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ef84bcf-fd86-40c7-a08c-a04230b954e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.305718 Nov 19 19:34:19.146709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 780/1584] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:19.154988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:19.156630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:19.166084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:19.168745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:19.169979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:19.170596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:19.224986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e72a1bff-a600-47dc-b147-cee63ade8b9a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076966 Nov 19 19:34:19.225894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 781/1585] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:19.241787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:19.254363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa10e3a3-ce86-43d4-aa33-a6a77111f4aa tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.258316 Nov 19 19:34:19.255209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 805/1586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:19.911883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:34:19.912284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:34:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:34:20.021420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:20.022506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:20.033331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.034090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.035629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.036354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.172150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:20.173039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:20.185901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.186707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.188122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.188897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.205972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:20.215144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:20.216805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:20.218363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-24d498a6-c1c8-451f-a8ef-b636470d7fd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.203593 Nov 19 19:34:20.218915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 782/1587] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:20.237392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:20.238401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:20.244650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.245096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.246638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.247073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.280497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9620d17f-9666-4ff9-baae-5112e0616fb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Nov 19 19:34:20.281412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 783/1588] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:34:20.285974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:20.286610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:20.293344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.293344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.294153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:20.294583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:20.380302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:20.388870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e309801-cd0f-4801-9665-472ef563bc43 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.221873 Nov 19 19:34:20.389472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 806/1589] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:20 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:20.457774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:20.466497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-395b28f1-53f6-4229-8dba-9d344b08a211 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.183810 Nov 19 19:34:20.467444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 784/1590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:21.237746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:21.238485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:21.245679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.246397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.247422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.248034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.292907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:21.294267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:21.301320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.301764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.302610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.303014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.349547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa6344d6-9180-44e7-8ae1-554b108b825b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060465 Nov 19 19:34:21.350616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 785/1591] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:21.411289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:21.412474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:21.423411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:21.423693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.424271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.425646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.426420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.433378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:21.434974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:21.436182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-819a3c6b-149d-4947-896d-592e7cfca7ca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.202833 Nov 19 19:34:21.436704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 807/1592] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:21.484084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:21.484701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:21.492707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.493270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.494709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:21.495454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:21.642663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:21.654355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a576cc6d-2571-41da-9f0a-a0aeaf3d9711 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.250243 Nov 19 19:34:21.654935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 786/1593] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:21.695230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:21.707956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-348e4ff0-4194-4ed3-93de-4edbdaa1508d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.227968 Nov 19 19:34:21.708968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 808/1594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:21 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:22.364055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:22.365134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:22.372334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.372841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.373674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.374190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.407262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b6492384-4772-441b-bd23-1bb9867c0a67 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046931 Nov 19 19:34:22.407909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 787/1595] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:22.455198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:22.455862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:22.463115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.463636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.464555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.465027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.606012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:22.614870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:22.616301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:22.617483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-744d158d-00aa-4472-b6ce-19972b953f4a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.166203 Nov 19 19:34:22.618032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 809/1596] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:34:22.671631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:22.672250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:22.678990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.679429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.680214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.680639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.733423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:22.734410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:22.741791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.742351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.743709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:22.744198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:22.864139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:22.873258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-02937169-0a00-4e6b-889d-57672f0cdb50 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.205254 Nov 19 19:34:22.873977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 788/1597] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:22.929236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:22.937359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5976a44-6515-41d5-a143-a37998b1470d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.208099 Nov 19 19:34:22.938035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 810/1598] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:22 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:23.419518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:23.420478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:23.427423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.427917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.428756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.429305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.460964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1231579b-d2b1-47db-b027-1c32275ae95f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045302 Nov 19 19:34:23.461546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 789/1599] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:23.636787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:23.637487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:23.645031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.645564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.646530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.647025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.804596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:23.815185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:23.816677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:23.817923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-152eadbc-1db7-47aa-a6c7-98cde1f36ead tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.185262 Nov 19 19:34:23.818503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 811/1600] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:23.892351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:23.892846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:23.899184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.899636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.900507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.900951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.959271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:23.960380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:23.972049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.972853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:23.974368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:23.975155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:24.123946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:24.135896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e5946ed-39bb-4768-a25b-3b0942adab27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.246879 Nov 19 19:34:24.136863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 790/1601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:24.184123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:24.193218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-22a05905-a74a-42bf-961c-44af4adbdaeb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.241212 Nov 19 19:34:24.193815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 812/1602] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:24.301386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:34:24.301669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:34:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:34:24.474067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:24.475007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:24.482507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:24.482987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:24.483765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:24.484206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:24.522528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-141f0ddf-e00d-4139-823b-cc77319e4d59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052368 Nov 19 19:34:24.523205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 791/1603] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:24.836270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:24.836905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:24.844417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:24.844863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:24.845653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:24.846084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:24.997146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:25.006726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:25.008196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:25.009400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b5dc84fb-51ce-4af4-b6d1-6c1aade29bda tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.176917 Nov 19 19:34:25.010026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 813/1604] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:25.154030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:25.154475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:25.161296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:25.161875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:25.162561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:25.162990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:25.216643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:25.218166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:25.229117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:25.230003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:25.232514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:25.233349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:25.344275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:25.353955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c16c224a-3e0f-4fda-b9e5-89a92ce765dc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.203870 Nov 19 19:34:25.354559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 792/1605] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:25.419613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:25.427537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc940b67-70e9-4a80-a8e8-423b5f8776cd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.218549 Nov 19 19:34:25.428126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 814/1606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:25 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:25.535092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:25.536044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:25.542887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:25.543451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:25.544236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:25.544661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:25.574323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01a008da-36d1-41c9-9f7a-9a3beb416b88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042962 Nov 19 19:34:25.574884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 793/1607] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:26.029580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:26.030276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:26.037790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.038322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.039152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.039619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.192098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:26.201011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:26.202591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:26.203883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbb16da8-6b0f-4c7a-8817-4473e0b7a19c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.178869 Nov 19 19:34:26.204506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 815/1608] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:26.377765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:26.378316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:26.384666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.385093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.386139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.386633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.452784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:26.453390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:26.459682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.460345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.460921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.461351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.558676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:26.566928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4317e9e-c34d-4822-bc76-60fb162ad775 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.192923 Nov 19 19:34:26.567598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 794/1609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:26.586317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:26.587259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:26.594350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.594794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.595572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:26.595994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:26.629341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-37c83055-7976-4ee2-ae40-2f66fab5cf88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046652 Nov 19 19:34:26.635281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 795/1610] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:34:26.646549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:26.655917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6c42b3f0-aeaa-430a-9ec2-1471a9c36982 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.206705 Nov 19 19:34:26.656520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 816/1611] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:26 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:27.225868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:27.226477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:27.233498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.233935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.234756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.235183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.376665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:27.386863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:27.388388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:27.389570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1f482d27-c38d-4e8c-91d8-727580180d5f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.167742 Nov 19 19:34:27.390149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 796/1612] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:27.591318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:27.592443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:27.599363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.599882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.600608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.601034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.643685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:27.644583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:27.651237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.652557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.653374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.654551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.692933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e94e7b84-acdf-416a-af3a-5b311a295016 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052967 Nov 19 19:34:27.693524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 797/1613] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:27.698460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:27.699375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:27.705840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.706317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.707112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:27.707548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:27.767744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:27.776252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88a4931e-426d-4550-8850-2409a69e28de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.188673 Nov 19 19:34:27.777108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 817/1614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:28.092527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:28.100267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bccc60ab-c95a-48d7-8462-56f7a3ad1ea4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.405689 Nov 19 19:34:28.100851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 798/1615] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:27 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:28.408490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:28.409101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:28.415429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:28.415882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:28.416678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:28.417273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:28.567267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:28.576779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:28.578323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:28.579535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b50a952f-e2c3-469b-8f05-96d43e23484e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174937 Nov 19 19:34:28.580147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 818/1616] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:28.704877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:28.705726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:28.712466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:28.712903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:28.713670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:28.714128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:28.743833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-371249a2-fe7c-42dc-a395-422ebdcdb458 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042928 Nov 19 19:34:28.744397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 799/1617] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:28.793203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:28.793843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:28.800894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:28.801354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:28.802173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:28.802610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:28.947775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:28.955619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-edb13eef-daf8-4c34-9741-e0b319b5a5b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166414 Nov 19 19:34:28.956108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 819/1618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:29.116928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:29.117573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:29.124213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.124690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.125525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.125950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.261531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:29.269071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3046790e-ab8c-4efe-855e-b0a5a5e36c0d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.155840 Nov 19 19:34:29.269600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 800/1619] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:29.599075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:29.599680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:29.606439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.606890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.607683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.608120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.747180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:29.756730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:29.757653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:29.758467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:29.759954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:29.761696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-804bcb59-96ac-46e7-a6d4-cb2a8ca3f4e6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.166177 Nov 19 19:34:29.762330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 820/1620] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:29.764471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.764930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.765763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.766235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.797011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-501fc04a-c147-425f-98f7-640a7a080b01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044019 Nov 19 19:34:29.797567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 801/1621] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:34:29.973199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:29.973768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:29.980510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.980961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:29.981746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:29.982216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.122674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:30.130766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8117ba27-afba-41d8-b9f9-4a85f39e2503 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161361 Nov 19 19:34:30.131333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 821/1622] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:30.286267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:30.286873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:30.293955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:30.294433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.295217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:30.295683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.434227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:30.442098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3fbb7be0-c2c0-4404-a3eb-ff3e26d0b301 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159515 Nov 19 19:34:30.442660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 802/1623] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:30 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:30.781679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:30.782340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:30.788858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:30.789313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.790101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:30.790560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.808976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:30.809988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:30.816791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:30.817233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.818007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:30.818464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:30.849903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-55ba6e16-3c97-4e04-b172-d2c02e0de136 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Nov 19 19:34:30.850497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 803/1624] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:30.930767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:30.939510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:30.940978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:30.942180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bc25fc3e-2b1a-48ad-b909-bc802d8d9165 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164385 Nov 19 19:34:30.942710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 822/1625] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:34:31.150879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:31.151812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:31.161071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.161793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.163075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.163786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.305097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:31.313459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4292da8-18bf-42cb-a1fa-9151a9ea1f8e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168457 Nov 19 19:34:31.314000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 804/1626] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:31.459811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:31.460359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:31.467640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.468079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.468859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.469293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.613081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:31.621015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ad7f4df-ba66-4a49-b89d-06cd98e6e421 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.164983 Nov 19 19:34:31.621561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 823/1627] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:31.862017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:31.862950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:31.871069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.871626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.872661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.873200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.909985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7d89a71d-55a9-4f2d-addd-a56cfc4eb61e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051700 Nov 19 19:34:31.910616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 805/1628] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:31.960901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:31.961500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:31.968722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.969159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:31.969926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:31.970393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.108500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:32.117442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:32.119454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:32.120247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f4b389df-d50d-4b56-b23d-0d490f740fce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.162962 Nov 19 19:34:32.121159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 824/1629] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:32.331229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:32.331873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:32.338407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:32.338982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.339759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:32.340191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.481552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:32.489677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5caf23c4-7666-4d69-8650-3c59711df207 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.162155 Nov 19 19:34:32.490258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 806/1630] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:32.638257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:32.638825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:32.645522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:32.645974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.646792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:32.647229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.786292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:32.793985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab8cc13f-cae8-41fa-9cca-d1176bcafc10 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159612 Nov 19 19:34:32.794752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 825/1631] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:32 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:32.921770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:32.922745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:32.929322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:32.929762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.930556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:32.931495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:32.960599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-378162ac-518a-4f4b-af17-09b2df5c5523 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042998 Nov 19 19:34:32.961166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 807/1632] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:33.139539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:33.140143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:33.146888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.147343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.148111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.148548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.286258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:33.297575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:33.299139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:33.300322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab6ea934-fec6-4c2f-b798-0d27c9761a03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.164813 Nov 19 19:34:33.300885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 826/1633] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:33.506997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:33.507606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:33.514624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.515074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.515859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.516293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.656647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:33.664556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9505e956-c0f5-417c-ac48-885512741807 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161233 Nov 19 19:34:33.665118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 808/1634] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:33.814749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:33.815320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:33.821782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.822261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.823448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.824002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.970945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:33.972085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:33.973299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:33.979710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96f33608-fba7-4401-8329-8ffdfd2bd491 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.168565 Nov 19 19:34:33.979937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.980405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.981227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:33.981686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:33.982452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 827/1635] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:33 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:34.015564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8eb52e7e-2faf-4aad-b796-c29acc0f3857 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047296 Nov 19 19:34:34.016164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 809/1636] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:34:34.319727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:34.320416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:34.327065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:34.327528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:34.328297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:34.328724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:34.473769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:34.482852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:34.484331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:34.485497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b580cd2b-54ba-490a-be70-6f898ee19397 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.169587 Nov 19 19:34:34.486084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 828/1637] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:34.684659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:34.685504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:34.694256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:34.694827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:34.695940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:34.696583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:34.847343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:34.855504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8a9b00e1-f758-4da9-a1f7-a3bbd4b13540 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.176264 Nov 19 19:34:34.856079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 810/1638] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:34.999839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:35.000444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:35.007184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.007577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.008356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.008798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.027530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:35.028437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:35.035043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.035492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.036284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.036716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.069590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-117ef30d-4f51-4199-aa63-6043d294a1bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045808 Nov 19 19:34:35.070192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 811/1639] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:34:35.153697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:35.161732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-18ddd802-7c29-4e1b-8d48-4071dce699d6 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.165566 Nov 19 19:34:35.162350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 829/1640] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:34 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:35.505300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:35.505902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:35.513351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.513790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.516323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.516766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.657130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:35.665971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:35.667589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:35.668761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ac26f81d-415f-4407-8b7d-2122b9c6e2f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.167656 Nov 19 19:34:35.669310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 812/1641] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:35.872841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:35.873359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:35.880196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.880647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:35.881421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:35.881857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.025785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:36.034411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fda714b0-2190-4a52-8f4a-41104af56b8a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165695 Nov 19 19:34:36.034986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 830/1642] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:36.081096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:36.082071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:36.089079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:36.089508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.090368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:36.090797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.121730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-171ea69c-3617-42cc-9c69-4bca9bfe9298 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044429 Nov 19 19:34:36.122337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 813/1643] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:36.181017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:36.181696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:36.192035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:36.192697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.194035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:36.194706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.343805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:36.351867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5deb33c1-6e13-4759-8b86-b17b53c104b2 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.175096 Nov 19 19:34:36.352427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 831/1644] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:36 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:36.687416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:36.688070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:36.694657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:36.695100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.695870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:36.696313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:36.827228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:36.836097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:36.837560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:36.838900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-463d54ef-0648-45cc-ae58-faaa4ea0728c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.155109 Nov 19 19:34:36.839426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 814/1645] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:37.051825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:37.052437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:37.059253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.059702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.060464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.060891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.133926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:37.134816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:37.142180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.142614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.143445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.143853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.174865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5e5ed598-a935-4213-9a0f-a66806e7541d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044754 Nov 19 19:34:37.175425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 815/1646] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:37.204753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:37.212692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-35cda87e-6ba3-41c7-850b-565594808432 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.164572 Nov 19 19:34:37.213287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 832/1647] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:37.368995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:37.369593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:37.376457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.376937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.377713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.378176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.522346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:37.529933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46b818b1-91cf-4b55-bbce-f361191ee71c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.164653 Nov 19 19:34:37.530530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 816/1648] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:37 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:37.859927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:37.860542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:37.867063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.867506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:37.868289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:37.868719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.037591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:38.049614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:38.051434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:38.052625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e932a7e6-c478-493e-ac0b-e105933b48af tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.196880 Nov 19 19:34:38.053191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 833/1649] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:38.187302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:38.188119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:38.195845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:38.196268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.197087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:38.197658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.229811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-922738c4-0cbd-4ad2-9d76-fc4c0d49f8f1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046529 Nov 19 19:34:38.230188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:38.230752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 817/1650] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:38.231026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:38.237732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:38.238205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.238977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:38.239418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.384471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:38.393345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-edbfb285-49ce-41da-a18e-9c9857d70ce5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166873 Nov 19 19:34:38.393884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 834/1651] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:38.547143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:38.547836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:38.554314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:38.554764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.555545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:38.555985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:38.701608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:38.709682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-09811d75-35ce-4c6d-81da-df5d212e5a30 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.166382 Nov 19 19:34:38.710344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 818/1652] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:39.071847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:39.072631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:39.080366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.080801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.081602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.082033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.236429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:39.241113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:39.242084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:39.247708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:39.249434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:39.249809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.251019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.251177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6100d9c7-3453-49b7-962b-ae9c1b697799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.182775 Nov 19 19:34:39.251280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.251672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.254543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 835/1653] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:39.287300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc2290d4-e354-418a-a8a5-f897fe3318fe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050097 Nov 19 19:34:39.287934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 819/1654] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:39.411967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:39.412490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:39.419902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.420344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.421139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.421570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.566422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:39.575040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d2aa127-233f-4ed0-9c26-8eb40903d444 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167085 Nov 19 19:34:39.575628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 836/1655] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:39.728023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:39.728536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:39.735635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.736086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.736867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:39.737294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:39.882859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:39.890489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-96f1ec38-f3a8-4884-86cc-95469659f310 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.166216 Nov 19 19:34:39.891060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 820/1656] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:39 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:40.268914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:40.269547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:40.285810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.286306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.287113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.287548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.302996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:40.304627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:40.315680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.316429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.317756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.318529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.375897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-28352f59-0756-4bc4-9498-0cc051f008e7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079739 Nov 19 19:34:40.376893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 821/1657] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:34:40.439883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:40.449164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:40.450692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:40.451857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e62bbba5-8524-4d18-af2e-abc2fe271993 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186824 Nov 19 19:34:40.452419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 837/1658] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:40.593122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:40.593687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:40.600262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.600701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.601468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.601896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.737609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:40.745753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a0956366-6a12-4350-b460-eb6f31cac75e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.156749 Nov 19 19:34:40.746567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 822/1659] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:40.907701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:40.908222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:40.914897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.915348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:40.916146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:40.916707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.058989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:41.066676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84ad92c0-1c5d-44d8-8ce3-1aee74e9e272 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162823 Nov 19 19:34:41.067236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 838/1660] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:41.390465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:41.391471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:41.398586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:41.399066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.399862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:41.400288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.433786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-49809903-0dc2-4759-8736-c15b599eab04 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047360 Nov 19 19:34:41.434439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 823/1661] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:41.470092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:41.470706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:41.477624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:41.478125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.478946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:41.479503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.626372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:41.637228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:41.638861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:41.640119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d18256c6-36a6-47ef-a2d2-1e71c8ed42c1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.174339 Nov 19 19:34:41.640699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 839/1662] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:41.765175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:41.765700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:41.772172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:41.772636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.774000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:41.774528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:41.948676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:41.956631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f12203dd-8e02-4694-b4a0-2f1e7d1f1582 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.197059 Nov 19 19:34:41.957205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 824/1663] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:42.083836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:42.084333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:42.096136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.096602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.097404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.097867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.253492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:42.261885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-97a883b0-f94f-477f-b329-0b95ba12f578 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.182088 Nov 19 19:34:42.262539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 840/1664] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:42 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:42.447653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:42.449249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:42.456044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.456492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.457275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.457693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.488999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-40a9d2a3-ebea-4bb6-8b69-3c54fafec275 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Nov 19 19:34:42.489557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 825/1665] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:42.659327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:42.659938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:42.666814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.667299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.668159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.668568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.808667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:42.819027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:42.820544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:42.821715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b411668f-ee39-46f4-bdc2-ba332a1421da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.166202 Nov 19 19:34:42.822315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 841/1666] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:42.975600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:42.976200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:42.984036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.984280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:42.985033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:42.985464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:43.128992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:43.136922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01bb234c-1e22-4a05-93ed-ef26c8a1a4fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165219 Nov 19 19:34:43.137517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 826/1667] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:43.279423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:43.280033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:43.286380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:43.286836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:43.287651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:43.288058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:43.429456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:43.437679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-05788753-8c10-43b1-81e0-2460c6304445 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.162096 Nov 19 19:34:43.438319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 842/1668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:43 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:43.500197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:43.501248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:43.511297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:43.512001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:43.512975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:43.513475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:43.544331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-718c650a-5462-4e54-a197-f6c01a259934 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047901 Nov 19 19:34:43.544903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 827/1669] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:43.841102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:43.842137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:43.849056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:43.849512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:43.850336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:43.850774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.004140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:44.014035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:44.015596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:44.016784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a4f3525-ca47-4743-a5bd-7ed74a563125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.179981 Nov 19 19:34:44.017368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 843/1670] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:44.155009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:44.155667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:44.162319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:44.162797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.163596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:44.164036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.316674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:44.324905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bdd4b441-bb7d-4a4f-9b00-774d370eb8c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.174195 Nov 19 19:34:44.325462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 828/1671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:44.455281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:44.455796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:44.462504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:44.462956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.464106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:44.464701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.556319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:44.557246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:44.564598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:44.564850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.565970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:44.566120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:44.597724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-503e8487-bd18-43b8-85e6-78862b54e406 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Nov 19 19:34:44.598336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 829/1672] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:44.630654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:44.639479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4eca3928-73f3-4171-9d77-ee8b9d030bc1 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.187965 Nov 19 19:34:44.640062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 844/1673] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:44 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:45.036422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:45.037028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:45.043644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.044090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.045257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.045519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.203784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:45.213308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:45.214931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:45.216236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3a55d20-c116-4e49-8016-0c3c19030e26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.183835 Nov 19 19:34:45.217186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 830/1674] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:45.342637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:45.343214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:45.350235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.350692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.351493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.351927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.491514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:45.499798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-150ca993-4873-4fcd-9958-b4d46a26a655 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161351 Nov 19 19:34:45.500381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 845/1675] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:45.610114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:45.610980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:45.618420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.618869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.619830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.620369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.654577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c87593ef-dc9e-4870-b7c4-94ff92636e89 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048321 Nov 19 19:34:45.655170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 831/1676] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:45.656672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:45.657305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:45.664626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.665080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.665885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:45.666369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:45.827687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:45.835593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e33ef380-4718-46b8-aaa4-bac48449bf65 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.182770 Nov 19 19:34:45.836169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 846/1677] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:45 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:46.235730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:46.236638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:46.242980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.243459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.244242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.245534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.502914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:46.512751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:46.514398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:46.515627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-104c3aa2-fe65-4fdb-b139-2384fe5aed18 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.283716 Nov 19 19:34:46.516395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 832/1678] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:46.517775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:46.518726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:46.526260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.527124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.527928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.528468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.666442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:46.667656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:46.674335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.674766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.675545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.675991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.709914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4d21e2e1-6b0f-44c5-bd0b-9b764d89cf96 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Nov 19 19:34:46.710508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 833/1679] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:46.736272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:46.744815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1061d686-88a5-4a63-b5bb-e9aac57aa60a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.231034 Nov 19 19:34:46.745049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 847/1680] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:46.853158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:46.853771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:46.860371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.860816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:46.861567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:46.861990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.001527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:47.009512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-df2480f1-84c4-4b5b-bcb9-a61879f4137c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.160116 Nov 19 19:34:47.010444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 834/1681] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:46 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:47.534398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:47.534960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:47.542449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:47.542898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.543676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:47.544102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.683732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:47.693132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:47.694898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:47.696114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cda7630d-dcdb-4416-a88a-b8be00eeec4e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.165658 Nov 19 19:34:47.696648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 848/1682] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:47.722461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:47.723431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:47.730211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:47.730666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.731451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:47.731882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.761649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:47.762433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:47.762893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4f65f2c2-5c7b-4876-b6ab-69958e4dc343 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Nov 19 19:34:47.763470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 835/1683] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:47.769281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:47.769706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.770544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:47.770973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:47.915138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:47.923572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a5011b32-0427-4e54-b5e7-06c3b4c5c202 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165939 Nov 19 19:34:47.924151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 849/1684] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:48.026370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:48.026999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:48.033508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.033920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.034769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.035169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.191544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:48.204746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4bb95f51-a5d3-4a73-931c-a748fba060b5 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.181984 Nov 19 19:34:48.205656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 836/1685] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:48 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:48.716076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:48.717407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:48.724690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.725121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.725925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.726393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.774633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:48.775548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:48.782427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.782869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.783643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.784068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.821077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c246f48-37ef-4165-8034-caf5f60dc95c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050076 Nov 19 19:34:48.821927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 837/1686] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:48.888073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:48.897702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:48.899328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:48.900619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-645a4604-c528-46b2-8d4f-845d2906a849 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.188641 Nov 19 19:34:48.901366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 850/1687] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:48.940965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:48.941585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:48.948490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.948968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:48.949792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:48.950267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:49.108308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:49.116571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d921faf5-c077-4dc8-aab1-b55909f86143 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.179232 Nov 19 19:34:49.117105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 838/1688] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:49.222983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:49.223622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:49.230330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:49.230783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:49.231583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:49.232028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:49.382765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:49.390787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-385a7700-ae39-475a-885e-d7e3fc3c9c74 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.171613 Nov 19 19:34:49.391374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 851/1689] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:49 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:34:49.833481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:49.834589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:49.841351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:49.842192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:49.843006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:49.843428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:49.886995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7446d2a-6f12-474d-9ec7-b2f6d88dd90b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057440 Nov 19 19:34:49.887600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 839/1690] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:49.921549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:49.922697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:49.931032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:49.931498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:49.932908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:49.933067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.074700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:50.083728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:50.085128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:50.086345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-180a54dd-ff52-4b01-991f-5978ed3082a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.170263 Nov 19 19:34:50.086907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 852/1691] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:50.134587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:50.135252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:50.141589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:50.142029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.142821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:50.143247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.284543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:50.294801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39f3a4fc-7227-4444-9db3-491b29b5692c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163896 Nov 19 19:34:50.295376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 840/1692] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:50.408105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:50.408625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:50.415198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:50.415649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.417103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:50.417103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.560931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:50.568860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd0374b8-36d4-4504-bfc2-6a16f8d93074 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.164648 Nov 19 19:34:50.569435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 853/1693] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:50 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:50.899045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:50.899983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:50.907616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:50.907616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.908416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:50.908931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:50.939849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a09d0865-11d1-4688-8389-b789ec7e53b9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044597 Nov 19 19:34:50.940404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 841/1694] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:51.105693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:51.106562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:51.116794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.117382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.118651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.119306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.260650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:51.269498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:51.271011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:51.272173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b77daa56-70be-4da2-802e-3a5566da0b8a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.170341 Nov 19 19:34:51.272721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 854/1695] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:51.311592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:51.312198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:51.318867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.319278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.320085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.320511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.468454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:51.476209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-319b5964-54c1-4382-b590-85c7e3522514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168427 Nov 19 19:34:51.476789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 842/1696] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:51.586397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:51.587058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:51.594031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.594499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.595291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.595713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.734643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:51.746699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2b873f3-2335-4e1d-a992-38c34d79cc5f tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.163971 Nov 19 19:34:51.747306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 855/1697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:51 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:51.953316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:51.954348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:51.961303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.961745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:51.962553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:51.962981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.002504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6b15db2-609e-438e-98a4-736811cd9cbd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054229 Nov 19 19:34:52.003083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 843/1698] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:52.292484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:52.293100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:52.301492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:52.301951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.302758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:52.303191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.461873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:52.471452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:52.472945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:52.474153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-595d5ff7-31dc-4a07-9976-3ad43aa1f00c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.186310 Nov 19 19:34:52.474731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 856/1699] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:52.492673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:52.493270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:52.499419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:52.499858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.500619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:52.501027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.647164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:52.655826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da2983e6-808c-488c-bd73-98811ad6252f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166791 Nov 19 19:34:52.656392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 844/1700] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:52 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:52.764623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:52.765232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:52.772200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:52.772645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.773425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:52.773855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:52.912280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:52.919967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4de4e4fb-8f93-4c8f-a892-738e6842b9d9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159180 Nov 19 19:34:52.920515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 857/1701] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:52 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:53.016725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:53.017619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:53.024800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.025287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.026192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.026632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.058138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5cea89d5-6e52-4db7-bee2-0afb8345d5b5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045177 Nov 19 19:34:53.058706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 845/1702] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:53.493463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:53.494101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:53.500984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.501433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.502273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.502709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.638682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:53.647700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:53.649206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:53.650422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6dcad68c-1bd3-4526-a401-60dc3343a316 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.160755 Nov 19 19:34:53.651372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 858/1703] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:53.678925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:53.679528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:53.686863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.687278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.688058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.688482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.823904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:53.832237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-522e8b5b-8a3a-418a-8ded-e90daef53787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.156833 Nov 19 19:34:53.833000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 846/1704] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:53.936927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:53.937438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:53.943898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.944343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:53.945110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:53.945537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:54.069924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:54.070992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:54.077368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:54.077814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:54.078632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:54.079062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:54.084656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:54.093376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dac34ef3-5dc2-4e0e-a1b3-53aa9bebf23d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.160224 Nov 19 19:34:54.093954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 859/1705] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:53 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:54.109841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67bbee12-e197-4453-9a29-ee87c0fdb74d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Nov 19 19:34:54.110437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 847/1706] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:54.669791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:54.670446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:54.677180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:54.677620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:54.678431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:54.678862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:54.816824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:54.826332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:54.827776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:54.828953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa7e0adf-1d6d-4f2b-9e49-f0e7052cded2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.163288 Nov 19 19:34:54.829503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 860/1707] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:54.850944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:54.851551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:54.857812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:54.858294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:54.859067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:54.859492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.007318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:55.017006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c5e8fee-7c61-4ecd-93fb-b62890418374 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.169734 Nov 19 19:34:55.017584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 848/1708] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:55.110872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:55.111365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:55.117858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:55.118346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.119134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:55.119674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.121430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:55.122383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:55.128906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:55.129357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.130326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:55.130760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.163414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-25e5ec18-2357-441c-99cb-a4b366b1edc8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046367 Nov 19 19:34:55.167219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 849/1709] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:55.282321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:55.290231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ea3bf04-1e0d-4757-a2e8-47046c71457a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.183188 Nov 19 19:34:55.290783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 861/1710] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:55 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:55.848606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:55.849204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:55.855841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:55.856286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.857055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:55.857481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:55.992942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:56.001676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:56.003173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:56.004326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a9e5dd03-2bac-4622-9dc5-552f2c8f1873 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.159495 Nov 19 19:34:56.004871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 850/1711] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:56.034613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:56.035468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:56.043044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:56.043565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:56.044381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:56.044815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:56.176774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:56.177935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:56.185232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:56.185670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:56.186500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:56.186963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:56.189840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:56.197641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1240cd7-f3c1-4986-805a-f25e64112dee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.166457 Nov 19 19:34:56.198809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 862/1712] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:56.219528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11d3927a-b8fe-4535-8bcf-2cedd82a0146 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Nov 19 19:34:56.220761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 851/1713] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:56.307462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:56.308024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:56.314579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:56.315268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:56.316063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:56.316522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:56.455379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:56.463255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4845ed26-85d2-432b-8d03-42b942392077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.159703 Nov 19 19:34:56.463960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 863/1714] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:56 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:57.023102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:57.023727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:57.030492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.030939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.031718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.032147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.168064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:57.176619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:57.178122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:57.179284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b9ed33f0-2012-4021-a586-0f7bfc53615b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.159992 Nov 19 19:34:57.179901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 852/1715] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:57.215631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:57.216271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:57.223158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.223601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.224368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.224801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.232019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:57.232971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:57.239661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.240111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.240917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.241339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.272348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-20d59886-6456-4acb-8d95-93f32baf0d9c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Nov 19 19:34:57.272922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 853/1716] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:34:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:34:57.359257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:57.367220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a84a29cc-e7f5-4277-bfa9-b3123ca1ada9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.155408 Nov 19 19:34:57.367810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 864/1717] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:57.481498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:57.482093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:57.488928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.489381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.490257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.490724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.629860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:57.638188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-02c0f732-8e78-4a63-af51-b2c317eb2c27 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1277 microversion: 2.1 time: 0.160760 Nov 19 19:34:57.638787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 854/1718] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1277 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:57.653987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:57.654513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:57.661021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.661470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.662301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.662718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.688272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:34:57.790552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d7177b6-0538-4aac-836e-6ff300c3a91c tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 204 len: 0 microversion: 2.1 time: 0.139878 Nov 19 19:34:57.791225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 865/1719] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:34:57 2021] DELETE /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:34:57.799608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:57.800220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:57.806572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.807059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.807870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:57.808303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:57.952498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:57.959931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-701f11b0-c01d-44fa-a6b3-5b9a47d4d3e9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.164032 Nov 19 19:34:57.960524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 855/1720] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:57 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:58.200165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:58.200744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:58.207381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.207849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.208620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.209090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.284486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:34:58.285415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:58.292239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.292709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.293824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.293927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.352046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:58.361377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:58.362877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:58.364187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-007168ce-dcb2-4dc2-81c4-6bdc6f196ccb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.169253 Nov 19 19:34:58.364818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 866/1721] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:58.387416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:58.388314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:58.390474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-53cb8c19-3b19-4ae0-9706-5415df598076 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action" status: 200 len: 83626 microversion: 2.1 time: 0.109102 Nov 19 19:34:58.391481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 856/1722] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:34:58 2021] POST /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2/action => generated 83626 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:34:58.397736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.398539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.399879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.401109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.541784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:58.549924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-93f1baf5-f76b-420b-969f-9b59c93aacd5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168556 Nov 19 19:34:58.550563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 867/1723] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:58.978464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:58.979580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:58.987661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.988113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:58.988906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:58.989367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:59.134531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:59.144126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe73ee52-3f9f-4d1e-b28b-56f1325c77cb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.169805 Nov 19 19:34:59.144716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 857/1724] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:58 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:34:59.383649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:59.384286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:59.391431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:59.391872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:59.392667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:59.393111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:59.533423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:59.542930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:59.544413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:59.545598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fde918db-fd00-4e7f-8dab-3a48e5429e8b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.165822 Nov 19 19:34:59.546182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 868/1725] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:34:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:34:59.567629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:34:59.568242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:34:59.575602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:59.577588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:59.577588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:34:59.577588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:34:59.724400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:34:59.732820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43357e03-9a9c-44f8-b94c-d310fb15d53c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168841 Nov 19 19:34:59.733435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 858/1726] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:34:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:00.162327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:00.162916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:00.170359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:00.170806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:00.171604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:00.172034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:00.313392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:00.321351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2db4c0db-55bf-4a80-a4aa-8a0060c6fa62 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.162704 Nov 19 19:35:00.321906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 869/1727] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:00 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:00.563971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:00.564535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:00.571168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:00.571813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:00.572988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:00.572988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:00.752424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:00.753234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:00.760392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:00.760830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:00.761652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:00.762098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:00.962617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:00.972219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:00.973857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:00.975075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5e7f7ef-07a1-43f2-8fd8-84c45c0eae56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.415330 Nov 19 19:35:00.976032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 859/1728] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:01.044121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:01.053068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b13630ec-c51b-4e12-a3ff-dae8d370a4ab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.304526 Nov 19 19:35:01.053684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 870/1729] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:01.338754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:01.339594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:01.347150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:01.347593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:01.348391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:01.348820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:01.500678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:01.509548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83308bb5-427f-483e-b65d-815a58ead209 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.174463 Nov 19 19:35:01.510227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 860/1730] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:01 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:01.996144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:01.996810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:02.004880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:02.005358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:02.006245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:02.006696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:02.070785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:02.071741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:02.077713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:02.078196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:02.078983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:02.079408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:02.175375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:02.184426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:02.185896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:02.187181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f222e59f-5a6a-4e34-929a-e810bc10de91 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.195894 Nov 19 19:35:02.189449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 871/1731] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:02.250500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:02.258751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a61dcb77-921c-4ca9-8086-8d0241c86c7c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.191565 Nov 19 19:35:02.259314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 861/1732] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:02.528670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:02.529183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:02.535946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:02.536390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:02.537174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:02.537601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:02.680362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:02.688426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6342a8c9-903d-4e98-bfe3-d3c30488686a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.163575 Nov 19 19:35:02.689001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 872/1733] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:02 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:03.205773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:03.206507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:03.213578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:03.214004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:03.214871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:03.215294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:03.276725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:03.277361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:03.286606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:03.286606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:03.287378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:03.287818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:03.379244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:03.388296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:03.389787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:03.391005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0be86ff-ed32-4b9f-8ffd-dac82c212133 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.189259 Nov 19 19:35:03.391554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 862/1734] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:03.449969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:03.457719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11a88fae-6fcb-4d13-b9f0-132ed6ae7d65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.185580 Nov 19 19:35:03.458240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 873/1735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:03.706640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:03.707249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:03.713934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:03.714367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:03.715134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:03.715571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:03.863112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:03.871879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a3c5526-510e-46a4-af99-bb7d80443a03 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.168916 Nov 19 19:35:03.872442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 863/1736] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:03 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:04.410079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:04.410670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:04.419349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:04.419788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:04.420574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:04.421022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:04.475606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:04.476240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:04.483300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:04.483755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:04.484547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:04.484983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:04.590754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:04.600327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:04.601681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:04.602779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cfc89b9f-154c-4ba5-9851-0ad5d7d5d49f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.196588 Nov 19 19:35:04.603413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 874/1737] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:04.656399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:04.670089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4514547c-b6c8-42e4-af43-af9dbb3a9636 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.198172 Nov 19 19:35:04.670687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 864/1738] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:04.889668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:04.890229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:04.896495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:04.896955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:04.897742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:04.898218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:05.042477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:05.050973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-27216586-c264-487a-afa9-e65d539c2077 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.165094 Nov 19 19:35:05.051555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 875/1739] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:04 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:05.621365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:05.621944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:05.629132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:05.629567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:05.630445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:05.630857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:05.687964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:05.688606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:05.695855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:05.696331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:05.697709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:05.698526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:05.810266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:05.819741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:05.821249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:05.822508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0b9af22e-c9a4-4218-88ff-c3d513309fbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.205256 Nov 19 19:35:05.823283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 865/1740] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:05.874751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:05.882847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9fde240-aeba-49a1-b773-ee3d3d504393 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.198786 Nov 19 19:35:05.883427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 876/1741] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:06.068698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:06.069304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:06.080415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:06.081388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:06.082259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:06.082846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:06.247527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:06.257350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0c1d173-a957-40a1-9ea7-eaa24ac74147 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.191956 Nov 19 19:35:06.258108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 866/1742] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:06.539422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:06.540051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:06.546842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:06.547704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:06.548629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:06.549169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:06.843079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:06.843688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:06.850338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:06.850790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:06.851581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:06.852013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:06.997941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:07.007867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:07.009343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:07.011096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eb495a95-2a5e-4aa8-9e87-17c66495e9ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.172515 Nov 19 19:35:07.011666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 867/1743] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:07.016043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:07.016618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:07.023319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:07.023781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:07.024575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:07.025114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:07.173397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:07.182218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5432c4e4-e434-49da-aae6-279aeff530b7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.168905 Nov 19 19:35:07.182916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 868/1744] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:07.277532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:07.278205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:07.284899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:07.285617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:07.286480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:07.286909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:07.434249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:07.442226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2862210d-dc36-4356-adf7-9a5623b452e4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.168384 Nov 19 19:35:07.442871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 869/1745] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:07 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:07.449709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1323990377", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "c78e7b75-b174-443c-b78e-86db23075f67"}]}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:35:07.515547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] validate_networks() for [('c78e7b75-b174-443c-b78e-86db23075f67', None, None, None, None, None)] {{(pid=116111) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:35:07.967791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:35:07.969915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:35:07.969915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Flavor pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:35:07.969915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Image pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:35:07.969915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:35:07.982465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:07.983101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:07.984228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:07.984829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.003604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:35:08.008069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Getting quotas for user 4df88e053d6049e9bee5470199b7295d and project bf4fd88b35e44dd7b34a67f1eb62db5b. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:35:08.021479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Going to run 1 instances... {{(pid=116111) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:35:08.023897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:35:08.080314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-468c228d-8389-4604-9fac-650d8f2058f9 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636338 Nov 19 19:35:08.081014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 870/1746] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:35:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:35:08.085448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:08.086232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:08.093317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:08.093763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.094655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:08.095029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.249235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:08.259910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:08.261493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:08.263046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b2a5aa2b-2a0d-4bb5-a950-532673a9251c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.180772 Nov 19 19:35:08.263635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 871/1747] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:08.268238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a0d3a501-b9b4-4379-a22a-b0af6127f2bd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:08.268842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a0d3a501-b9b4-4379-a22a-b0af6127f2bd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:08.328619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a0d3a501-b9b4-4379-a22a-b0af6127f2bd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:08.335966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a0d3a501-b9b4-4379-a22a-b0af6127f2bd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1218 microversion: 2.1 time: 0.070963 Nov 19 19:35:08.346722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 872/1748] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:08 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:08.354986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:08.355704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:08.363030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:08.363477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.364272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:08.364709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.516481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:08.524220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-44c3dcdc-9ae4-48dc-9a37-ad0f0bc4ade7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.174207 Nov 19 19:35:08.525100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 873/1749] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:08.529288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:08.529835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:08.535986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:08.536479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.537308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:08.537784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:08.685354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:08.698479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f31e3d5f-2aa0-4099-8223-cf3aa8d5b8bb tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.171969 Nov 19 19:35:08.699372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 874/1750] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:09.282931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:09.284090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:09.290195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:09.291015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:09.292001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:09.292453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:09.620159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:09.629877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:09.631509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:09.632702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-945f1b8b-d22a-4a13-8d5d-3d3bce172903 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.354537 Nov 19 19:35:09.644125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 875/1751] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:35:09.644125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:09.644125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:09.645746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:09.646232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:09.647033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:09.647570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:09.728960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:09.736537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6b47586f-a90c-49fc-9d4c-b19b472f0829 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1276 microversion: 2.1 time: 0.101864 Nov 19 19:35:09.737090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 876/1752] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:09 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1276 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:09.741622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:09.742266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:09.749360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:09.749817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:09.750639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:09.751067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:09.981707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:09.990334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c7028482-8dc6-40bc-971e-9421db549ea4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.251339 Nov 19 19:35:09.990334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 877/1753] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:09.994797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:09.995371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:10.002023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:10.002491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:10.003280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:10.003715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:10.257368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:10.265602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-53ca8a27-b0fa-4181-8060-426b1aafb8ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.274216 Nov 19 19:35:10.276371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 878/1754] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:09 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:10.652948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:10.653653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:10.660155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:10.660594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:10.661928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:10.661928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:10.916515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:10.932950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:10.934990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:10.936239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5161d63a-c938-4f76-b4f8-37f5049ef35e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.288159 Nov 19 19:35:10.936815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 879/1755] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:10.941400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:10.942012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:10.949808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:10.950328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:10.951123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:10.951557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.211826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:11.220237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b335abad-8e81-4ef1-9f22-cdc170c4ae3c tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1318 microversion: 2.1 time: 0.282331 Nov 19 19:35:11.220826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 880/1756] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:10 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1318 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:11.234642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:11.235274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:11.243020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.243471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.244311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.244740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.516039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:11.523891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b5fd74e-e942-4487-ae1f-21c28c6b54f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.292939 Nov 19 19:35:11.524467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 881/1757] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:11.612154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-bbc6a9b4-12ea-49fb-8c3f-0d7eefc0dedf req-7d493379-60f9-4caf-86e2-d2d519806017 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c76ce3-c438-4f1b-bbae-6e1de878cf06", "tag": "c8491e9e-ce25-4829-9767-b63dc9a7eed5"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:35:11.613836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:35:11.613836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:35:11.621247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-bbc6a9b4-12ea-49fb-8c3f-0d7eefc0dedf req-7d493379-60f9-4caf-86e2-d2d519806017 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.621890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-bbc6a9b4-12ea-49fb-8c3f-0d7eefc0dedf req-7d493379-60f9-4caf-86e2-d2d519806017 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.633734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-bbc6a9b4-12ea-49fb-8c3f-0d7eefc0dedf req-7d493379-60f9-4caf-86e2-d2d519806017 service nova] Creating event network-changed:c8491e9e-ce25-4829-9767-b63dc9a7eed5 for instance f6c76ce3-c438-4f1b-bbae-6e1de878cf06 on hv-cinder-77703 Nov 19 19:35:11.639555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-bbc6a9b4-12ea-49fb-8c3f-0d7eefc0dedf req-7d493379-60f9-4caf-86e2-d2d519806017 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113700 Nov 19 19:35:11.640401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 882/1758] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:35:11.645355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:11.646309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:11.657723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.658577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.659677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.660178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.901933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:11.910153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-82a924cf-9e83-4c20-988c-ddd2b69ea320 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.268491 Nov 19 19:35:11.910745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 883/1759] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:11 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:11.967483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:11.968206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:11.977832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.979909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:11.980721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:11.981157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:12.222368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:12.232092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:12.233591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:12.234781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4a980db-071b-4010-bd41-cac85bc91421 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 200 len: 1751 microversion: 2.20 time: 0.274566 Nov 19 19:35:12.235342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 884/1760] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:35:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 1751 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:35:12.239505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:12.240328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:12.251191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:12.251640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:12.252412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:12.252879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:12.652830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:12.660426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d2288ae2-715c-42a4-a3e3-8e286f2435ce tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1318 microversion: 2.1 time: 0.424087 Nov 19 19:35:12.661140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 885/1761] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:12 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1318 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:12.665764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:12.666401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:12.672824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:12.673264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:12.674240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:12.674672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:12.816997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:12.825451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e0cdc78-27ad-41e5-bb86-7219164362af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163198 Nov 19 19:35:12.826020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 886/1762] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:12.928391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:12.928886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:12.936323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:12.936801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:12.937584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:12.938013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:13.096692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:13.105154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8057a62a-dea7-4edf-bc6c-e9487f1c5e41 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.180599 Nov 19 19:35:13.105732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 887/1763] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:12 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:13.679255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:13.679984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:13.686726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:13.687171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:13.687947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:13.688368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:13.841821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:13.850808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-76c3cc69-d4dc-4067-9ab1-aa64c0366108 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1318 microversion: 2.1 time: 0.175214 Nov 19 19:35:13.851687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 888/1764] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:13 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:13.856597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:13.857197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:13.863842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:13.864290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:13.865067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:13.865493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:14.004178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:14.012246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-884b22a2-7b90-4dae-b5f9-8926e0b6cbda tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.159748 Nov 19 19:35:14.012815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 889/1765] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:14.122811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:14.123427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:14.129558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:14.129995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:14.130782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:14.131206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:14.279764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:14.288412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cf217470-bda1-4700-a905-3b91d39b56dd tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.169342 Nov 19 19:35:14.288998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 890/1766] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:14 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:14.874998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:14.875743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:14.883240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:14.883814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:14.885035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:14.885596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:15.037607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:15.046405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b5052946-f5f7-4672-bb0b-3dc4382d2833 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1318 microversion: 2.1 time: 0.175028 Nov 19 19:35:15.047210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 891/1767] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:14 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:15.052377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:15.053019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:15.062986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:15.063755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:15.065195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:15.065978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:15.242829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:15.252287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-839a7556-d0e0-4266-bad5-f0e4fadffcc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.204005 Nov 19 19:35:15.253043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 892/1768] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:15.306354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:15.307075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:15.314416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:15.314919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:15.315772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:15.316292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:15.464574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:15.478967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6f1141cc-e2b3-4d10-af45-a01080535dcc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.176056 Nov 19 19:35:15.479987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 893/1769] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:15 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:16.024186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-ff5f4c18-f08d-43b6-9cb0-098e98e23e5d req-6a1d1127-f948-47ac-ad7b-7ef472d8a245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c76ce3-c438-4f1b-bbae-6e1de878cf06", "name": "network-vif-plugged", "status": "completed", "tag": "c8491e9e-ce25-4829-9767-b63dc9a7eed5"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:35:16.026713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:35:16.026713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:35:16.035734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-ff5f4c18-f08d-43b6-9cb0-098e98e23e5d req-6a1d1127-f948-47ac-ad7b-7ef472d8a245 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.036245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-ff5f4c18-f08d-43b6-9cb0-098e98e23e5d req-6a1d1127-f948-47ac-ad7b-7ef472d8a245 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.049849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-ff5f4c18-f08d-43b6-9cb0-098e98e23e5d req-6a1d1127-f948-47ac-ad7b-7ef472d8a245 service nova] Creating event network-vif-plugged:c8491e9e-ce25-4829-9767-b63dc9a7eed5 for instance f6c76ce3-c438-4f1b-bbae-6e1de878cf06 on hv-cinder-77703 Nov 19 19:35:16.056095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-ff5f4c18-f08d-43b6-9cb0-098e98e23e5d req-6a1d1127-f948-47ac-ad7b-7ef472d8a245 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035766 Nov 19 19:35:16.057592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 894/1770] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:35:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:35:16.070552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:16.072385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:16.082787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.083980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.085647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.086686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.298650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:16.306818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8becc1d4-b34d-4e47-b46a-db8ef1c9b495 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1318 microversion: 2.1 time: 0.243507 Nov 19 19:35:16.307411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 895/1771] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:16 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:16.311945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:16.312716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:16.320196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.320639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.321455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.322031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.466971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:16.475829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-420c5ef7-33a0-4e92-9b75-10ee6fd4c2b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167321 Nov 19 19:35:16.476409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 896/1772] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:16.509297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:16.509938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:16.516440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.516888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.517679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:16.518121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:16.672632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:16.681835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-812d0531-7956-4906-a66e-39d31566fc08 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.176186 Nov 19 19:35:16.682861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 897/1773] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:16 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:17.326677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:17.327419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:17.334142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:17.334603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:17.335413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:17.335846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:17.488945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:17.499753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-726030ed-d54c-4d2d-a54d-33be8a4d1cdd tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1318 microversion: 2.1 time: 0.176078 Nov 19 19:35:17.501428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 898/1774] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:17 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:17.510568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:17.511791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:17.519650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:17.520192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:17.521078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:17.521596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:17.684402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:17.692567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a47a4d54-74e9-4171-bc10-f6d3dedb65f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.189436 Nov 19 19:35:17.693165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 899/1775] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:17.700318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:17.700942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:17.707835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:17.708289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:17.709135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:17.709574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:17.863357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:17.871531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4a87a65b-9a02-46eb-97f4-68e8c259f412 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.176124 Nov 19 19:35:17.872174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 900/1776] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:17 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:18.519607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:18.520357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:18.527423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:18.527895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:18.528681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:18.529111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:18.680895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:18.694707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-410e3067-01da-4562-8f0f-e6f4df6dfe27 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1507 microversion: 2.1 time: 0.178537 Nov 19 19:35:18.695789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 901/1777] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:18 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:18.717239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:18.717851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:18.727318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:18.728731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:18.730286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:18.731048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:18.884351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:18.893014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5f56c7f1-8bf6-417c-9aca-a1efe2068a12 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.180408 Nov 19 19:35:18.893594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 902/1778] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:18.898242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:18.898847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:18.906313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:18.906777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:18.907920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:18.908107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:19.055175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:19.063707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe94a6d1-16b8-43c8-9035-6579403a07ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.168930 Nov 19 19:35:19.064309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 903/1779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:18 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:19.912881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:19.913611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:19.920310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:19.920757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:19.921521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:19.921947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:20.074452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:20.082329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-23bc57d0-d26b-454b-a755-11fcfb211500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.173133 Nov 19 19:35:20.082895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 904/1780] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:20.087188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:20.087937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:20.094679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:20.095129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:20.095900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:20.096321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:20.260139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:20.268666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31cdd6a8-2b9a-46bb-9264-60ecc3f5126d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.184693 Nov 19 19:35:20.269209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 905/1781] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:20 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:21.101592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:21.102340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:21.109117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:21.109562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:21.110392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:21.110813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:21.264441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:21.272859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e582f36e-74be-428e-83fe-ee1caa39031c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.174908 Nov 19 19:35:21.273429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 906/1782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:21.286674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:21.287293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:21.295610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:21.296191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:21.297067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:21.297625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:21.442431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:21.450612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-428aae70-c598-44dc-8ee8-c53717d62c46 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.168249 Nov 19 19:35:21.451227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 907/1783] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:21 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:22.291100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:22.291802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:22.298597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:22.299048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:22.299840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:22.300274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:22.438226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:22.446230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd1fa14b-9536-4ed6-bef0-f7933c3bb03c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158788 Nov 19 19:35:22.446980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 908/1784] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:22.468124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:22.468714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:22.474889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:22.475329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:22.476094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:22.476517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:22.615473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:22.623338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9bd23822-8b42-4714-ac3c-4346ea113975 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.159292 Nov 19 19:35:22.623877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 909/1785] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:22 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:23.463896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:23.464640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:23.471922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:23.472371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:23.473133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:23.473560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:23.616829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:23.625085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-82ad9ede-c5c7-4646-8ba0-18a2d28685da tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.165184 Nov 19 19:35:23.625660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 910/1786] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:23.640727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:23.641317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:23.648050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:23.648494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:23.649285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:23.649723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:23.797304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:23.804974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61a277f7-cbaf-437f-9790-8c35edfbb9de tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.167859 Nov 19 19:35:23.806185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 911/1787] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:23 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:24.643011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:24.643688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:24.650554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:24.650992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:24.651765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:24.652217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:24.794538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:24.803013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a2fa9653-6e20-44a4-82e6-0960d76700d8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.163663 Nov 19 19:35:24.803599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 912/1788] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:24.822458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:24.823219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:24.829872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:24.830347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:24.831164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:24.831592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:24.982978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:24.991171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cc436e3e-8fe6-4f34-868f-41f34dbd40a9 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.172489 Nov 19 19:35:24.991746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 913/1789] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:24 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:25.820816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:25.821771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:25.829691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:25.830187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:25.830999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:25.831435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:25.990457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:25.998395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-005618e8-02bd-49ae-a6a5-f7250e5599ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.181275 Nov 19 19:35:25.998956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 914/1790] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:26.008052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:26.008649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:26.015632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:26.016097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:26.016853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:26.017282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:26.176210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:26.185835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-59be56eb-b82d-41ea-b23a-af2ce30e783e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.181016 Nov 19 19:35:26.186491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 915/1791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:26 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:27.017000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:27.017749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:27.024566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:27.025506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:27.026258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:27.026815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:27.180092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:27.192217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c0e29b42-421d-4e87-acb1-50991b7bb6a5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.179267 Nov 19 19:35:27.192820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 916/1792] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:27.203996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:27.204653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:27.212242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:27.212889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:27.213950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:27.214641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:27.356445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:27.364476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f85bb5c8-8544-4366-beeb-2b164ddffc71 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.164442 Nov 19 19:35:27.365052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 917/1793] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:27 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:28.211670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:28.213231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:28.220597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:28.221098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:28.222348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:28.222841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:28.373124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:28.382527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6cd9b1a-93f9-45d2-b076-99d3d8fb9e75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.175140 Nov 19 19:35:28.383101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 918/1794] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:28.387693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:28.388282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:28.394871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:28.395311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:28.396079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:28.396505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:28.547943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:28.556019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b6ef6d0-0ccc-4eb5-9998-9f3319c27548 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.171804 Nov 19 19:35:28.556626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 919/1795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:28 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:29.400231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:29.400949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:29.408172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:29.408608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:29.409379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:29.409803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:29.550132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:29.557877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-76bc8af4-cdd9-4289-b058-2a0f12992e73 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.161355 Nov 19 19:35:29.558480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 920/1796] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:29.581874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:29.582496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:29.589581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:29.589999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:29.590870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:29.591641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:29.737789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:29.746275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-064b26a6-aa0e-443a-985f-4090bbe70d4d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.167957 Nov 19 19:35:29.746851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 921/1797] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:29 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:30.574472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:30.575231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:30.583260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:30.583987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:30.585260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:30.586037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:30.795903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:30.803980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-15538d35-3d14-4369-ad57-2a62d9c90ae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.233565 Nov 19 19:35:30.804596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 922/1798] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:30.809381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:30.809991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:30.816125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:30.816575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:30.817364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:30.817800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:30.958879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:30.967700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-390f3ae3-5631-4268-ae9f-e2982e2025ac tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.162071 Nov 19 19:35:30.968282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 923/1799] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:30 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:31.824473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:31.825555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:31.833839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:31.834341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:31.835203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:31.835673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:31.983406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:31.991494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c0db741b-6dd2-4de3-90b9-cc5435255417 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.171264 Nov 19 19:35:31.992066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 924/1800] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:31.996931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:31.997527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:32.004072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:32.004524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:32.005300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:32.005727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:32.144471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:32.152176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dece7160-6e7e-48d5-8201-7a83546f0e4e tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.159038 Nov 19 19:35:32.152764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 925/1801] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:31 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:32.992139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:35:32.993050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:35:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac (ip 10.222.0.46) !!! Nov 19 19:35:33.013784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:33.014654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:33.023646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:33.024383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:33.025943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:33.027158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:33.235349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:33.244545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-10404153-dba3-4d5c-9315-1e80b8fe98d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.236033 Nov 19 19:35:33.245065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 926/1802] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:33.249511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:33.250158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:33.257622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:33.257622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:33.258271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:33.258862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:33.409486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:33.418312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d9d00e75-0e16-4c5d-8f3c-5eef8df3f8cc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.172091 Nov 19 19:35:33.418906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 927/1803] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:33 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:34.264584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:34.265373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:34.272569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:34.273012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:34.273802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:34.274350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:34.436888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:34.445920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8758e900-b78e-4b62-9cff-1cfc4c4505b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.185117 Nov 19 19:35:34.446915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 928/1804] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:34.451707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:34.452323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:34.459033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:34.459471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:34.460256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:34.460680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:34.635207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:34.643509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-60a92a1c-ede5-4f12-a3a9-a145174ae453 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.195472 Nov 19 19:35:34.644081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 929/1805] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:34 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:35.464961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:35.465800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:35.473218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:35.473672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:35.474531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:35.474972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:35.639303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:35.647859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6dd83b21-b6f7-4b3b-a656-3cb3381a57d3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.186671 Nov 19 19:35:35.648466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 930/1806] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:35.662851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:35.663451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:35.670173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:35.670623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:35.671432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:35.671860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:35.815306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:35.823864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-96fcc575-98be-46d1-9973-a9c418530946 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.166335 Nov 19 19:35:35.824362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 931/1807] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:35 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:36.668939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:36.669632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:36.676710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:36.677159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:36.677967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:36.678433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:36.825080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:36.833048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e639ff90-8972-4524-b786-55567a7278b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.167859 Nov 19 19:35:36.833607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 932/1808] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:36.849450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:36.849981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:36.856889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:36.857338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:36.858194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:36.858629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:37.011303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:37.019490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5648981-f680-4a80-b210-b4d742c1fac4 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.173860 Nov 19 19:35:37.020078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 933/1809] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:36 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:35:37.852195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:37.853107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:37.860112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:37.860559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:37.861361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:37.861793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:38.019880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:38.028508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c58204bb-9a03-4946-ad90-17bfb098a705 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.180060 Nov 19 19:35:38.029094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 934/1810] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:38.036413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:38.037023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:38.044466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:38.044917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:38.045704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:38.046149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:38.198980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:35:38.207000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2970bea4-a7e9-46d6-9275-83080bb8b62a tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.174095 Nov 19 19:35:38.207592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 935/1811] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:35:38 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:35:38.744537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:35:39.042398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:35:39.042977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:35:39.050025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:39.050391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:35:39.051186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:35:39.051621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.706069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-026a379e-d059-4025-a17b-8d1f82518c86 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 202 len: 0 microversion: 2.1 time: 120.170617 Nov 19 19:37:06.706987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 877/1812] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:35:06 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 0 bytes in 120172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:37:06.712422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:06.713166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:06.720483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.720916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.721716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.722188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.768255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:37:06.768948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:37:06.770013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de7ed8dd-8127-4de1-806e-3dc1983cf6c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 87.733109 Nov 19 19:37:06.770982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 936/1813] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:35:39 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 87735 msecs (HTTP/1.1 409) 9 headers in 380 bytes (2 switches on core 0) Nov 19 19:37:06.777208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:06.778030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:06.785662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.786136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.787643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.788100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.896344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:37:06.904339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be72d7c5-9e32-4760-bc88-a58822ca5182 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.196157 Nov 19 19:37:06.905403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 878/1814] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:37:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:37:06.909293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:06.909779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:06.915773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.916214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.917256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.917735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.969836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:37:06.977918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43bc0999-cd3a-443f-9826-c6f6672e7191 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.205854 Nov 19 19:37:06.978778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 937/1815] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:37:06 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:37:06.983484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:06.983980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:06.989941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.990302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:06.991090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:06.991523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:16.536096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:37:16.536836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:37:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac (ip 10.222.0.46) !!! Nov 19 19:37:29.421831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:37:29.422494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:37:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c (ip 10.222.0.46) !!! Nov 19 19:37:39.357373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:37:39.397964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:37:39.398607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:37:39.399451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-57400cfc-f7c9-4a27-bba4-b24470cab92c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 32.419642 Nov 19 19:37:39.400035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 938/1816] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:37:06 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 32421 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:37:39.474132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:39.474738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:39.480769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:39.481252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:39.482207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:39.482516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:39.625489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:37:39.633526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe336cb4-ecc8-4975-b8f1-86a9f1582913 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.232539 Nov 19 19:37:39.634188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 939/1817] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:37:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:37:39.714100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:39.715240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:39.721870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:39.722338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:39.723109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:39.723547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:39.869414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:37:39.877512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32305a57-f4ea-4f48-8519-6a29ced6f580 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.242249 Nov 19 19:37:39.878095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 940/1818] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:37:39 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:37:39.882475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:37:39.882961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:37:39.890580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:39.891386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:39.892769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:37:39.893401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:37:39.930656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:37:39.930880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:37:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac (ip 10.222.0.46) !!! Nov 19 19:37:44.320230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:37:44.320988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:37:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac (ip 10.222.0.46) !!! Nov 19 19:38:53.014075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:38:53.014690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:38:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac (ip 10.222.0.46) !!! Nov 19 19:39:07.369507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7587274e-b7f0-4fb5-b297-701b537bd637) Nov 19 19:39:07.370156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7587274e-b7f0-4fb5-b297-701b537bd637) {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:39:07.370977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2d74b2f2-1ee8-4d35-9b0f-3bfea3cbe081 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 400 len: 269 microversion: 2.1 time: 120.465137 Nov 19 19:39:07.372061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 879/1819] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:37:06 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 269 bytes in 120466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:39:07.377639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:39:07.378275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:39:07.385152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:07.385606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:07.386431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:07.386851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:07.418396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:39:07.524089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:39:07.531646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7cfc2ac7-aadb-482e-9563-555b6df021d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.158871 Nov 19 19:39:07.532236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 880/1820] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:39:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:39:07.536830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:39:07.537302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:39:07.550896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:07.551786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:07.552668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:07.553174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:09.703987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:39:09.704644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:39:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c (ip 10.222.0.46) !!! Nov 19 19:39:39.617822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49ebd52f-9a5f-4a0d-81f9-ab942deb8ea1) Nov 19 19:39:39.618464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-49ebd52f-9a5f-4a0d-81f9-ab942deb8ea1) {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:39:39.619319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7dd3554f-42b6-4b26-9fa0-e7165477ddae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 400 len: 269 microversion: 2.1 time: 119.740282 Nov 19 19:39:39.620425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 941/1821] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:37:39 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 269 bytes in 119741 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:39:39.625021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:39:39.625615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:39:39.632212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.632644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.633429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.633859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.663738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:39:39.665062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:39:39.665905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8666cd90-c2fd-431a-aa9d-e38f0d0748bb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 32.132764 Nov 19 19:39:39.666917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 881/1822] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:39:07 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 32134 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:39:39.671368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:39:39.672357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:39:39.679082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.679521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.680318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.680773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.720383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8093add3-e32c-4c43-be3a-8b91c4154869 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052447 Nov 19 19:39:39.720969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 882/1823] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:39:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:39:39.725469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:39:39.725947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:39:39.731715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.732153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.732934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.733358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.781111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:39:39.788616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0b580e53-f3aa-45cc-8769-01557a98a89d tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1265 microversion: 2.1 time: 0.167609 Nov 19 19:39:39.789192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 942/1824] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:39:39 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:39:39.794190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:39:39.794706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:39:39.800740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.801509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:39:39.802454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:39:39.802892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:40:36.555393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:40:36.556009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:40:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac (ip 10.222.0.46) !!! Nov 19 19:40:49.443145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:40:49.443801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:40:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c (ip 10.222.0.46) !!! Nov 19 19:40:59.951491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:40:59.952261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:40:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c (ip 10.222.0.46) !!! Nov 19 19:41:04.338554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:41:04.338554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:41:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c (ip 10.222.0.46) !!! Nov 19 19:41:08.181680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:41:08.422830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:41:08.424054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:08.425157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2893cd2a-11b4-4447-b388-69571b2acd9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 88.634846 Nov 19 19:41:08.425894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 943/1825] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:39:39 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 88636 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:41:08.432122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:08.433024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:08.441984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.443285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.444152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.444651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.661064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:08.670519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5eddb0a-fc4e-45bd-aa7e-3d0531490079 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.243310 Nov 19 19:41:08.671590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 944/1826] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:08.676307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:08.677310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:08.692373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.692959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.693836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.694453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.912133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:08.920056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb6e0c2c-ba7b-4308-a766-47a79de02058 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1209 microversion: 2.1 time: 0.247082 Nov 19 19:41:08.920603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 945/1827] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:08 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1209 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:08.925071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:08.926115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:08.933398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.933763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.934588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.935022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.966563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-993c5ef7-d94a-4a8a-b421-ec8d0af3bcd0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044805 Nov 19 19:41:08.967466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 946/1828] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:08.972448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:08.972937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:08.980500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.980946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:08.981732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:08.982182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:39.861157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bbe4c7f-5c0b-4edb-b154-6f40127cc145) Nov 19 19:41:39.862178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-1bbe4c7f-5c0b-4edb-b154-6f40127cc145) {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:39.863818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd2b189b-345e-43ed-b83e-cdf65ddd08b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 400 len: 269 microversion: 2.1 time: 120.141428 Nov 19 19:41:39.864800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 883/1829] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:39:39 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 269 bytes in 120143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:41:39.872007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:39.872678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:39.888221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:39.889061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:39.890339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:39.890869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:39.963841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:41:40.162178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:41:40.163687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:40.165548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d1cf678c-340b-48ab-8083-471f6f21b700 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 0.299316 Nov 19 19:41:40.166861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 884/1830] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:41:39 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 301 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:41:40.174411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.175442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.183644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.184177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.185280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.185743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.243106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e18cb70a-ee22-4679-89ab-f95cc3f8a060) Nov 19 19:41:40.243966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e18cb70a-ee22-4679-89ab-f95cc3f8a060) {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:40.244959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c1ab97e-45ba-45a4-b50f-bc7da0207bc9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 400 len: 269 microversion: 2.1 time: 31.276089 Nov 19 19:41:40.245560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 947/1831] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:41:08 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 269 bytes in 31278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:41:40.255940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.257191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.271681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.272584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.273492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.274927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.362033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:40.375378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62d86875-f1ff-47b2-ad29-3452736e62c8 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1142 microversion: 2.1 time: 0.127800 Nov 19 19:41:40.376764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 948/1832] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1142 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:40.388724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.391507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.398846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.399979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.400808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.401243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.421675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:40.430518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-67318659-f85a-4574-ac4d-fbe241c04eb9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1563 microversion: 2.1 time: 0.261705 Nov 19 19:41:40.431127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 885/1833] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1563 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:40.436405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.436869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.437436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-275d52f6-9686-4810-a370-d8bb808d6cd9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058716 Nov 19 19:41:40.438020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 949/1834] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:40.442999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.443726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.444220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.444442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.445577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.446258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.450648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.451143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.452266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.452712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.570599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:41:40.646505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:41:40.647101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:40.648081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-759820b1-5ac9-4f91-a030-5ee8abc208a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 0.208791 Nov 19 19:41:40.648654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 950/1835] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:41:40 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:41:40.653314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.653916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.660304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.660735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.661526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.661946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.703746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c63073-61b2-4cf5-96d2-54a52d6a01d1) Nov 19 19:41:40.705455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0c63073-61b2-4cf5-96d2-54a52d6a01d1) {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:40.707601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dae37882-177e-4378-b578-a028fc9aafe3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 400 len: 269 microversion: 2.1 time: 0.274846 Nov 19 19:41:40.708651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 886/1836] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:41:40 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 269 bytes in 277 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:41:40.719591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.721653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.733145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.733941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.735412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.736205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.877170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:40.887223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc4d0115-c753-4e4c-ab44-e8721c013ca0 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1142 microversion: 2.1 time: 0.176327 Nov 19 19:41:40.888211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 887/1837] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:40 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1142 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:40.889618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:40.897003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.899278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.903368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f079e003-648c-4bc1-8b25-7b63af2f6634 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1563 microversion: 2.1 time: 0.253291 Nov 19 19:41:40.904756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 951/1838] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:40.910655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.911353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.913452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.914175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:40.914389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.915502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:40.925555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.926621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.927930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:40.928616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:40.966431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ba7f8ee7-ebca-4782-b487-fcef9660a4f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076218 Nov 19 19:41:40.967341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 888/1839] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:41.082577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid e13558fb-6c01-4fec-8683-7cf251c8e43e {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:41:41.270150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b3ad358-d6de-4e90-ace0-955408b070c2) Nov 19 19:41:41.270784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0b3ad358-d6de-4e90-ace0-955408b070c2) {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:41.271678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-20404b22-f380-462e-8a89-89bfb88c0002 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac" status: 400 len: 269 microversion: 2.1 time: 0.365275 Nov 19 19:41:41.278344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 952/1840] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 19:41:40 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e/os-volume_attachments/b5ee6935-ba15-42e5-b2bc-6b483374c0ac => generated 269 bytes in 373 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:41:41.283563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:41.284058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:41.292827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.293290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.294254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.294705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.318530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-6464d715-ffde-454f-9c9f-41ef985a5bda req-23575750-2076-4ba0-9dac-4fdba7a09afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54959e8f-aff5-49c3-a76e-a89d678c18a4", "name": "network-vif-deleted", "tag": "e44d6bf4-f226-405c-8f2e-d6cf27150e97"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:41:41.322780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:41:41.322780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:41:41.353939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-6464d715-ffde-454f-9c9f-41ef985a5bda req-23575750-2076-4ba0-9dac-4fdba7a09afb service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.355377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-6464d715-ffde-454f-9c9f-41ef985a5bda req-23575750-2076-4ba0-9dac-4fdba7a09afb service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.375687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.compute.server_external_events [req-6464d715-ffde-454f-9c9f-41ef985a5bda req-23575750-2076-4ba0-9dac-4fdba7a09afb service nova] Unable to find a host for instance 54959e8f-aff5-49c3-a76e-a89d678c18a4. Dropping event network-vif-deleted {{(pid=116110) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 19 19:41:41.377205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-6464d715-ffde-454f-9c9f-41ef985a5bda req-23575750-2076-4ba0-9dac-4fdba7a09afb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.408055 Nov 19 19:41:41.378510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 889/1841] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:41:40 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 410 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 19 19:41:41.388316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:41.390026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:41.398809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.399383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.400078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.400505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.476001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning Nov 19 19:41:41.477187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Cannot 'detach_volume' instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d while it is in task_state spawning {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:41:41.478525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-566fe1f8-9ac4-474c-bd67-e30d647ab58a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c" status: 409 len: 155 microversion: 2.20 time: 0.198920 Nov 19 19:41:41.479267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 953/1842] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 19:41:41 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments/554d5fcb-ed47-49f6-a71b-c1a210a5fa8c => generated 155 bytes in 200 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:41:41.486253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:41.487072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] [instance: 54959e8f-aff5-49c3-a76e-a89d678c18a4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:41.497555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.498359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.499567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.500013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.566298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:41.577156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f3b678b7-7edf-49f2-8332-5a613ec0d1eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1563 microversion: 2.1 time: 0.196892 Nov 19 19:41:41.577900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 890/1843] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1563 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:41.584570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4cceacd1aa1e47a5bf03e02d2cf64fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62170a929e0f4fb5aad1a629f86de1f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:41.588210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:41.590285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:41.601162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5068b5ff-ab7b-4784-9978-38fc39a3ba83 tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4" status: 200 len: 1142 microversion: 2.1 time: 0.119432 Nov 19 19:41:41.601333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.601908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.603103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 954/1844] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:41 2021] GET /compute/v2.1/servers/54959e8f-aff5-49c3-a76e-a89d678c18a4 => generated 1142 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:41.603331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.604050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.613899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:41.616274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:41.628382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.629729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.631502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:41.632650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:41.666316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-09154167-0bb7-4ba7-a8dd-a8ea1ee387d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086553 Nov 19 19:41:41.668326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 891/1845] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:41.696945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6be5bd4c-0406-4474-a39f-464ba81fb4ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092257 Nov 19 19:41:41.698256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 955/1846] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:42.682926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:42.683770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:42.691560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.692334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.693778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.694585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.715415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:42.717100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:42.730683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.732133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.734951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7673c4d0-a369-4746-b886-0c83ca524e8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055005 Nov 19 19:41:42.735143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.735297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 892/1847] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:42.741587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.771211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:42.771873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:42.778842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.779288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.780127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.780562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.800596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6daaab5f-b8fa-4b77-94ee-a3ccab7bbd42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092369 Nov 19 19:41:42.801644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 956/1848] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:42.809658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:41:42.909198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-f6a8213d-8e36-4bbe-b592-ebf25b50e818 req-e04ed6ea-5c76-43a6-989c-2517192e498e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1894db7d-c20a-4bcc-8fd3-cf13d214a5ae", "tag": "52339b2d-1214-4a37-8df2-c8f15a213a8a"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:41:42.911047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:41:42.911047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:41:42.922604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-f6a8213d-8e36-4bbe-b592-ebf25b50e818 req-e04ed6ea-5c76-43a6-989c-2517192e498e service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.923051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-f6a8213d-8e36-4bbe-b592-ebf25b50e818 req-e04ed6ea-5c76-43a6-989c-2517192e498e service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.929438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-adfaa2e3-f129-40dc-894e-b88c82e99b17 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "DELETE /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 204 len: 0 microversion: 2.1 time: 0.161209 Nov 19 19:41:42.930798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 893/1849] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:41:42 2021] DELETE /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 19 19:41:42.938026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-f6a8213d-8e36-4bbe-b592-ebf25b50e818 req-e04ed6ea-5c76-43a6-989c-2517192e498e service nova] Creating event network-changed:52339b2d-1214-4a37-8df2-c8f15a213a8a for instance 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae on hv-cinder-77703 Nov 19 19:41:42.948619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-f6a8213d-8e36-4bbe-b592-ebf25b50e818 req-e04ed6ea-5c76-43a6-989c-2517192e498e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136364 Nov 19 19:41:42.949700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 957/1850] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:41:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:42.950222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:42.951601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:42.964814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.965260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:42.966442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:42.966775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:43.422689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:43.433044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9dff0dd9-654f-4863-8470-d82cb5e838e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1569 microversion: 2.1 time: 0.494499 Nov 19 19:41:43.434335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 894/1851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1569 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:43.752192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:43.753945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:43.763477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:43.764124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:43.765155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:43.765867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:43.819940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:43.822210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-425332bf-ca5c-4f4b-9a58-afe23d27d023 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077035 Nov 19 19:41:43.823017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 958/1852] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:41:43.823893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:43.836141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:43.837170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:43.838319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:43.839239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:43.878181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-83362ef2-4b7c-4c47-afe2-9fd4b68c6591 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065477 Nov 19 19:41:43.879005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 895/1853] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:44.458992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:44.462470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:44.468357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-ca510434-1e1b-43b2-ba3f-7081e09566cb req-b49955ef-c974-4696-93de-ec02f2115f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1894db7d-c20a-4bcc-8fd3-cf13d214a5ae", "name": "network-vif-deleted", "tag": "52339b2d-1214-4a37-8df2-c8f15a213a8a"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:41:44.470501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:41:44.470501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:41:44.479360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-ca510434-1e1b-43b2-ba3f-7081e09566cb req-b49955ef-c974-4696-93de-ec02f2115f7e service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.479793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-ca510434-1e1b-43b2-ba3f-7081e09566cb req-b49955ef-c974-4696-93de-ec02f2115f7e service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.479939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.480403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.481353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.481884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.495899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-ca510434-1e1b-43b2-ba3f-7081e09566cb req-b49955ef-c974-4696-93de-ec02f2115f7e service nova] Creating event network-vif-deleted:52339b2d-1214-4a37-8df2-c8f15a213a8a for instance 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae on hv-cinder-77703 Nov 19 19:41:44.506388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-ca510434-1e1b-43b2-ba3f-7081e09566cb req-b49955ef-c974-4696-93de-ec02f2115f7e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042274 Nov 19 19:41:44.509502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 896/1854] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:41:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:44.581477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:44.593499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a9f33d0-0b50-4592-818f-68e781142436 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1384 microversion: 2.1 time: 0.143419 Nov 19 19:41:44.594429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 959/1855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1384 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:44.837683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:44.838861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:44.846377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.846947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.847853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.848376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.882601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e20e4d8b-34c9-4604-ad59-200b297b7377 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049697 Nov 19 19:41:44.883449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 897/1856] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:44.890794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:44.891746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:44.899016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.899621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.900619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:44.901086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:44.936247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a364df98-0bb9-43b6-9e28-c3b5dab29835 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049428 Nov 19 19:41:44.936888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 960/1857] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:45.613204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:45.613945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:45.621470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:45.621916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:45.622772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:45.623206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:45.696254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:45.704640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-332465ec-26c7-4eb3-97f9-aa877ab3fed8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095186 Nov 19 19:41:45.705236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 898/1858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:45.895538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:45.896445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:45.904850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:45.905392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:45.906338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:45.906842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:45.943289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1abf0ccb-1384-4807-b8b7-ed617d72d702 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051399 Nov 19 19:41:45.944132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 961/1859] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:45.951355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:45.952415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:45.961279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:45.961841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:45.962772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:45.963266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:46.004860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-144ddadf-8a2f-4004-80f5-adf7a0958f47 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060222 Nov 19 19:41:46.005866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 899/1860] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:46.733841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:46.734992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:46.746705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:46.747400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:46.748579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:46.749189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:46.847095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:46.856135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e60fb089-ff91-4af1-b81d-1565199af64d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.130489 Nov 19 19:41:46.856704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 962/1861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:46.959232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:46.960328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:46.968647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:46.969197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:46.970073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:46.970581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:47.006429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7dfbcbc-4c5b-4054-afa8-bf752a9f5583 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051126 Nov 19 19:41:47.006953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 900/1862] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:47.018921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:47.019957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:47.027574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:47.028115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:47.028997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:47.029489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:47.065496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f85e399d-ee59-47d2-8ad2-52dc530b13e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050440 Nov 19 19:41:47.066653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 963/1863] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:47.872844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:47.873450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:47.879956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:47.880396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:47.881214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:47.881641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:47.947915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:47.959827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e2b5814-36d9-4524-9172-b71640de86a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090259 Nov 19 19:41:47.961129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 901/1864] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:48.019345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:48.020385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:48.028459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:48.028921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:48.029776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:48.030364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:48.065196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-019dcc04-c761-4d1f-b542-07cb7b9b528f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050513 Nov 19 19:41:48.065787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 964/1865] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:48.079095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:48.080159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:48.088176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:48.088788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:48.089703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:48.090292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:48.128145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6b44d3b8-a01c-4618-a958-420adc0a2a6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053265 Nov 19 19:41:48.128735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 902/1866] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:48.980755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:48.981356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:48.988056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:48.988521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:48.989293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:48.989726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:49.065709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:49.076592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:49.077526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:49.080182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b69a86ae-0461-4c10-b1ef-b88e1e9cb7a7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102927 Nov 19 19:41:49.081200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 965/1867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:41:49.084609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:49.085121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:49.086247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:49.086701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:49.121025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b607f41-a122-443e-8b42-d27cb85242a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048045 Nov 19 19:41:49.121593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 903/1868] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:49.141355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:49.142316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:49.149097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:49.149540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:49.150369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:49.150798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:49.185345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f2d9d3db-d778-41ce-86f2-f8ade29c1356 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047920 Nov 19 19:41:49.185888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 966/1869] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:50.109717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:50.110863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:50.121799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:50.124150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:50.124150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:50.124568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:50.137935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:50.139811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:50.150736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:50.151679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:50.153286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:50.154169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:50.213620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-705ac4d6-711f-4f03-98ab-01a0d7c064c4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082675 Nov 19 19:41:50.214749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 967/1870] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:50.223871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:50.225680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:50.233531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:50.234253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:50.235461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:50.235943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:50.247051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:50.262031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f767077f-cefa-4c33-abb4-bc26f48e22e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.159415 Nov 19 19:41:50.263381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 904/1871] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:41:50.279739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3904d35c-b34e-41e9-a907-53ba284d07d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063456 Nov 19 19:41:50.280446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 968/1872] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:51.227507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:51.228367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:51.236141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:51.236592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:51.237407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:51.237846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:51.272332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-65e1f988-a5e9-4958-a5db-1d84c7e297b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049332 Nov 19 19:41:51.273266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 905/1873] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:51.287804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:51.288706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:51.292304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:51.293228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:51.295613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:51.296053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:51.296885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:51.297313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:51.299853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:51.300319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:51.301117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:51.301553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:51.334297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7960a1eb-219e-4ac8-a763-d7a6a02e2818 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046073 Nov 19 19:41:51.334874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 906/1874] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:51.364275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:51.372860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0a49c91-25d7-4ce7-8e6f-0fdc0cd51bdb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088742 Nov 19 19:41:51.373416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 969/1875] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:52.285250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:52.286203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:52.293880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:52.294511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:52.295618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:52.296179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:52.348066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:52.349004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:52.356191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:52.356570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8c0f99b-997a-446c-8ac3-d8a904ba05ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074511 Nov 19 19:41:52.356781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:52.357503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:52.357693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 907/1876] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:52 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:52.357937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:52.390417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:52.391015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:52.395693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-08fc482c-3699-490b-b265-66939df4ce86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051399 Nov 19 19:41:52.396695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 970/1877] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:52.398419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:52.398893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:52.399772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:52.400213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:52.474578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:52.484188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-27f50076-49b5-4311-8359-f7134baa8771 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097440 Nov 19 19:41:52.484836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 908/1878] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:52 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:53.375739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:53.377539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:53.390390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:53.391115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:53.392567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:53.393326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:53.412858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:53.415011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:53.426352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:53.427003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:53.428177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:53.428976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:53.430997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dd8e52a4-591f-4e1e-a80a-c69c49194ccb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062480 Nov 19 19:41:53.431602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 971/1879] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:53.467998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6e385a1-2c87-48b2-a4d8-27854640cbea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061846 Nov 19 19:41:53.468726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 909/1880] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:53.503724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:53.504580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:53.512640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:53.513140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:53.513984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:53.514504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:53.584933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:53.594315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31bce325-e350-494b-a3b6-2b090c15f8f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095619 Nov 19 19:41:53.595102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 972/1881] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:54.448053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:54.450086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:54.462305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:54.463196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:54.464675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:54.465518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:54.481161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:54.482033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:54.488877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:54.489318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:54.490142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:54.490578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:54.509204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-227b34cc-bff5-4ddd-badb-9139c4d3d14b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068482 Nov 19 19:41:54.510185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 910/1882] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:54.527639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6ba1d54-86b4-46e2-910a-071e762705b0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050740 Nov 19 19:41:54.528232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 973/1883] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:54.613218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:54.613900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:54.621540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:54.621991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:54.622847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:54.623283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:54.689867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:54.699775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5db39b46-3010-41f8-ac28-ed00879494db tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090195 Nov 19 19:41:54.700466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 911/1884] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:55.524829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:55.525822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:55.534961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:55.535574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:55.536562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:55.537127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:55.543538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:55.544855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:55.552676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:55.553215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:55.555047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:55.555261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:55.577181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-304acf40-9b8a-4816-b8cd-9dc13922eb0d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057084 Nov 19 19:41:55.577772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 974/1885] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:55.597139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9d0f88fa-6c0c-49fb-a5dd-201400ab40d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059067 Nov 19 19:41:55.598154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 912/1886] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:55.718310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:55.719042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:55.726244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:55.726749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:55.727740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:55.728209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:55.794455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:55.802917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4648a74b-8bd4-40da-9ee9-204d11c073ae tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089204 Nov 19 19:41:55.803479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 975/1887] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:56.591248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:56.592087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:56.599709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:56.600161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:56.601164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:56.601597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:56.613698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:56.615096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:56.626785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:56.627308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:56.628143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:56.628613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:56.639974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-196b81c5-21c2-49cc-8933-0c97ef597681 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052608 Nov 19 19:41:56.640804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 913/1888] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:56.671478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dd594800-e7c8-4329-9133-43fd11315567 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062168 Nov 19 19:41:56.672115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 976/1889] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:41:56.829348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:56.830022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:56.838125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:56.838667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:56.839497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:56.839972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:56.927616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:56.936672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6b9f1dd-a402-4ecd-b2c0-ff51b6365e1e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.111190 Nov 19 19:41:56.937573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 914/1890] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:57.653389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:57.654310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:57.661750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:57.662435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:57.664071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:57.664694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:57.687432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:57.689033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:57.700124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad836bc6-c1c9-41c4-8199-cc9c187a866e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050701 Nov 19 19:41:57.700688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 977/1891] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:57 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:57.700877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:57.703489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:57.704982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:57.705573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:57.745763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-44c8ee6b-b0c9-4e72-a9f7-e8b50e82f6f6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065564 Nov 19 19:41:57.746391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 915/1892] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:57.956424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:57.956980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:57.964322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:57.964817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:57.965699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:57.966482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:58.036346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:58.051039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-520a2165-efff-4c89-b05b-f5c7f73bbdbc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098059 Nov 19 19:41:58.052092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 978/1893] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:58.716138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:58.716991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:58.724470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:58.724921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:58.725894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:58.726688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:58.758405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:58.759471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:58.762698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-82bf168b-1b29-4fc3-ab06-16c0e476207a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050788 Nov 19 19:41:58.763330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 916/1894] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:41:58.767582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:58.768024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:58.768812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:58.769240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:58.803970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62618302-db72-4239-9657-aaa91e2d9b16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050226 Nov 19 19:41:58.804906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 979/1895] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:41:59.072851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:59.073479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:59.081028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:59.081488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:59.082368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:59.082815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:59.172435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:41:59.189779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-345cb6b8-94e3-4759-a81f-c6d07db59787 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.123487 Nov 19 19:41:59.190417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 917/1896] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:41:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:41:59.780162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:59.780162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:59.786910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:59.787369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:59.788343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:59.788778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:59.821351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:41:59.822629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:41:59.824940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cef15912-7cfc-4c2d-a78b-8155e2d8dd75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053015 Nov 19 19:41:59.826003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 980/1897] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:41:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:41:59.840070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:59.840070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:59.840070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:41:59.840070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:41:59.878477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9740b5f3-1cfa-441d-8885-7610c462b1bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062186 Nov 19 19:41:59.879085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 918/1898] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:41:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:00.209472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:00.210608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:00.218385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:00.218905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:00.219746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:00.220183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:00.292400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:00.301480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a336d1e7-ebe9-4e7e-a1ad-17625c02c20e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097461 Nov 19 19:42:00.302074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 981/1899] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:00.839069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:00.840208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:00.848396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:00.848927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:00.849823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:00.850584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:00.886406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bb7bd73a-542e-4db0-a2e4-339f00458884 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051261 Nov 19 19:42:00.887616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 919/1900] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:00.893440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:00.894570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:00.903016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:00.903534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:00.904525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:00.904998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:00.942313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e969f7ac-64ad-4397-bf5b-157848d89132 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055516 Nov 19 19:42:00.942894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 982/1901] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:01.319335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:01.320025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:01.327187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:01.327663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:01.328469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:01.328904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:01.401782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:01.416329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04181f4e-63db-4a7d-8ef6-1c45365d2016 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100535 Nov 19 19:42:01.417375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 920/1902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:01.903512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:01.904692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:01.912666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:01.913356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:01.914156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:01.914548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:01.949549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b85d74e3-a206-4416-a975-cbb8145346a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052078 Nov 19 19:42:01.950236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 983/1903] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:01.957363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:01.958401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:01.966324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:01.966920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:01.967528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:01.968324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:02.001755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bf9884bd-5a26-452b-9933-516329774562 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050444 Nov 19 19:42:02.002399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 921/1904] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:02.442075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:02.442942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:02.450346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:02.450796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:02.451588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:02.452045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:02.524991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:02.533506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d717d03b-9477-4154-807e-57da13893674 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095321 Nov 19 19:42:02.534473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 984/1905] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:02.964143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:02.965069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:02.972671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:02.973135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:02.973956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:02.974428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:03.009517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c9a94d0e-d29f-4d75-89d7-50b94c5c14d8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049556 Nov 19 19:42:03.010119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 922/1906] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:03.018635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:03.020480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:03.031889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:03.032809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:03.034309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:03.035088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:03.095087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95da73de-36ee-4a3e-a2f9-c55ba8c26ae0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083198 Nov 19 19:42:03.096039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 985/1907] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:03.552462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:03.553264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:03.560501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:03.560977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:03.561824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:03.562315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:03.629129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:03.638540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e2b6866e-d842-4885-a9dc-82073dfa2194 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090164 Nov 19 19:42:03.639146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 923/1908] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:04.021697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:04.023016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:04.030134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:04.030638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:04.031480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:04.031916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:04.068068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c023ac07-5f5f-402c-b21e-5538152bf1d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050197 Nov 19 19:42:04.068665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 986/1909] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:04.109712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:04.110684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:04.118941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:04.119391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:04.120211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:04.120648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:04.158696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-22853f1c-7618-42e6-a84a-265b531ede33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052920 Nov 19 19:42:04.159365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 924/1910] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:04.664637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:04.665572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:04.672633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:04.673106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:04.674007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:04.674581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:04.742749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:04.751217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee6ae35e-b03e-4612-b35c-943f7258262b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090703 Nov 19 19:42:04.751802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 987/1911] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:05.084538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:05.086806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:05.098219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:05.098937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:05.100607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:05.101457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:05.139587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be84ad59-b707-4c26-9ddf-6bddc14adf32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062173 Nov 19 19:42:05.140327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 925/1912] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:05.174660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:05.176275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:05.188143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:05.188901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:05.190358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:05.191099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:05.248789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6368e30a-ceba-4620-b9fe-e0958f562799 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080868 Nov 19 19:42:05.249748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 988/1913] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:05.769765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:05.770420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:05.778339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:05.778894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:05.779705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:05.780226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:05.852046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:05.861410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a63bc896-4e3d-4590-83ce-506b04922d9a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095494 Nov 19 19:42:05.862089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 926/1914] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:06.152277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:06.153298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:06.161114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:06.161626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:06.162630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:06.163147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:06.202353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dd2eb3ef-d2c2-475e-95f0-03ce2e222ac7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054706 Nov 19 19:42:06.203162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 989/1915] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:06 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:06.262712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:06.263680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:06.271335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:06.271894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:06.272786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:06.272786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:06.309310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a02b100a-89f0-48a6-895e-df23e6361cfc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050547 Nov 19 19:42:06.309908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 927/1916] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:06.883775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:06.884841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:06.896342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:06.897202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:06.899269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:06.900018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:06.977694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:06.985961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1460da3f-7b15-4a37-83ef-2f40c8fcf268 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.109147 Nov 19 19:42:06.986620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 990/1917] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:07.322533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:07.324164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:07.331812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:07.332497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:07.333453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:07.334094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:07.358359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:07.359525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:07.366718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:07.367363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:07.368509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:07.369141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:07.373826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4e02338-f01e-4e39-9790-011ae216af48 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055682 Nov 19 19:42:07.374776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 991/1918] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:07.406712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ed5d375a-f963-427f-b7e0-f461bc8e36e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195515 Nov 19 19:42:07.407334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 928/1919] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:08.003941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:08.004698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:08.013492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:08.013937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:08.014853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:08.015281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:08.089031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:08.098222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88c239a6-8b60-409e-8b79-dd993b304db1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098047 Nov 19 19:42:08.099191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 992/1920] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:08.389239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:08.390099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:08.397664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:08.398194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:08.399205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:08.399647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:08.421242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:08.422589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:08.431778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:08.432378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:08.433358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:08.433894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:08.434744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d560432e-f6ac-4d88-a31d-3a57f63d1111 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049497 Nov 19 19:42:08.435391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 929/1921] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:08.482147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3e3a63a0-49d6-4b24-853c-9b0b4c54f275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065039 Nov 19 19:42:08.482788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 993/1922] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:09.120499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:09.121118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:09.128560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:09.129068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:09.130159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:09.130643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:09.204788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:09.221520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ae5c35c-b9c4-421a-876c-e1e3c5305698 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.105063 Nov 19 19:42:09.222468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 930/1923] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:09.451254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:09.452500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:09.462289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:09.462959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:09.464148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:09.464764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:09.495278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:09.496673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:09.504515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:09.505147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:09.506194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:09.506742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:09.518438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4fb087f6-e078-4e32-8d6a-875b69af8ac3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072747 Nov 19 19:42:09.519523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 994/1924] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:09.546818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef15ac96-3244-4144-b90d-68fdf7bb3fae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055712 Nov 19 19:42:09.547825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 931/1925] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:10.244432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:10.245523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:10.257740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:10.257740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:10.258910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:10.259670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:10.356482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:10.370711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32fe492d-c294-4361-9486-fdb0c70a6764 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.133150 Nov 19 19:42:10.371772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 995/1926] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:10.534981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:10.536073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:10.545310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:10.546013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:10.547160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:10.547928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:10.568740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:10.570413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:10.586625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:10.587442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:10.588910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:10.589670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:10.595804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5757923-de11-4126-8030-40c364c1994b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065027 Nov 19 19:42:10.596601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 932/1927] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:10.635314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6460e857-0a53-489e-b533-cba27a7113fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079276 Nov 19 19:42:10.636083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 996/1928] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:11.400717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:11.401914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:11.411659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:11.412434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:11.413866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:11.414686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:11.493021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:11.502333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-82cef46b-9084-4ff2-ab79-421f57983a51 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.108616 Nov 19 19:42:11.502952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 933/1929] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:11.609635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:11.610490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:11.617753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:11.618240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:11.619049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:11.619475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:11.652200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:11.653742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:11.658882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b1e02612-f9c0-43ef-8ba3-c31b4805f5ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053274 Nov 19 19:42:11.659530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 997/1930] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:11.661685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:11.662290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:11.663537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:11.664068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:11.699192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0fab866d-6f45-4a8c-91d2-a9fb0b525823 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053460 Nov 19 19:42:11.699787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 934/1931] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:12.520832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:12.521430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:12.528957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:12.529456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:12.530530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:12.531105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:12.611039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:12.620427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6f83849-9948-47d9-8d92-02e4b6715c78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104016 Nov 19 19:42:12.620991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 998/1932] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:12.675350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:12.676599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:12.684950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:12.685397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:12.686261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:12.686701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:12.712366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:12.713375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:12.722342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:12.723060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:12.724328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:12.724644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-65297cd3-d808-4626-a4e7-d2e373fa52ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054184 Nov 19 19:42:12.725036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:12.725930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 935/1933] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:12.763421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ead80a86-508e-43c7-985f-fb812d20fad4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055656 Nov 19 19:42:12.764113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 999/1934] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:12 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:13.032901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:42:13.033223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:42:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:42:13.642091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:13.643215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:13.654254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:13.655123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:13.656462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:13.657235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:13.732971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:13.740269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:13.741577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-235457c0-0d9d-4468-8491-948776e2935c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.106594 Nov 19 19:42:13.742222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 936/1935] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:13.742926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:13.750626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:13.751099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:13.752025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:13.752336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:13.779563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:13.781361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:13.791657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:13.792377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:13.793480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:13.794242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:13.800902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cbf0190e-f27b-4039-a261-eb2934a443b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065386 Nov 19 19:42:13.801767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1000/1936] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:13.834417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1b14a79c-0542-4dad-84d0-6d8daa764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061274 Nov 19 19:42:13.835361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 937/1937] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:14.768395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:14.769040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:14.777886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:14.778412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:14.779271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:14.779836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:14.819780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:14.821384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:14.833140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:14.833891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:14.835491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:14.836258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:14.854203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:14.867041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-109b6296-40c8-45cb-9ba2-37bafd816a1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101902 Nov 19 19:42:14.867996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1001/1938] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:14 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:14.876087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:14.877587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:14.887695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:14.888417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:14.889732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:14.890474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:14.894803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5224f940-1ebe-4f53-a955-b20ecdbd414d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.081544 Nov 19 19:42:14.895769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 938/1939] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:14.929190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f17afce1-62f0-4cb3-8186-ac06c7381971 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059091 Nov 19 19:42:14.929839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1002/1940] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:15.887719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:15.888320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:15.895591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:15.896014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:15.896827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:15.897557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:15.914845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:15.916742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:15.928528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:15.929314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:15.931836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:15.932583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:15.977964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:15.986835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8258921-409b-45b1-a36f-d6e9fb3fea3c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102932 Nov 19 19:42:15.987472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 939/1941] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:15.992302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:15.993231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:15.995069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a6aac7c-d494-4eba-bcd4-d0092120725d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.087783 Nov 19 19:42:15.996579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1003/1942] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:16.006342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:16.007241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:16.008846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:16.009599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:16.046165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1dac0ef2-ee00-422a-98d4-d9eefe00260a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057523 Nov 19 19:42:16.046762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 940/1943] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:17.008207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:17.008980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:17.010846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:17.012496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:17.016279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:17.016731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:17.017558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:17.017992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:17.021642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:17.022212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:17.023280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:17.023883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:17.071947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a7bb874e-98b7-4216-8119-ed237b702fee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067930 Nov 19 19:42:17.073009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1004/1944] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:17.082135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:17.083677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:17.087381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:17.095152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:17.095935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:17.096054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be51ce70-1878-43e4-b9ea-f437bca857f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092243 Nov 19 19:42:17.096668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 941/1945] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:17.097303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:17.098197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:17.161085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62c6217e-3b61-4219-965f-88fd3a82982a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086103 Nov 19 19:42:17.162179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1005/1946] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:17 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:18.085470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:18.087017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:18.094893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:18.095336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:18.096141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:18.096574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:18.116849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:18.118353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:18.129792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:18.130483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d30799a3-ae86-492b-9311-0d2dba69183d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049010 Nov 19 19:42:18.130674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:18.131396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 942/1947] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:18.132396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:18.133172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:18.174368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:18.175292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:18.183560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:18.184093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:18.184979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:18.185707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:18.226490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1e6473d-215b-46f9-9546-e90e19b7c505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054370 Nov 19 19:42:18.226490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 943/1948] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:18.230618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:18.244168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-490a00a8-6428-4556-a79d-2da67a090ddc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.133976 Nov 19 19:42:18.245193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1006/1949] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:19.143028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:19.143838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:19.151344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:19.151793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:19.152612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:19.153046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:19.190156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3bab634d-c6a1-4b51-97c0-3f71fa1addd9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050940 Nov 19 19:42:19.190908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 944/1950] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:19.240099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:19.241569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:19.250799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:19.251240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:19.252062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:19.252494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:19.266293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:19.267358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:19.277637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:19.278509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:19.279854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:19.280558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:19.288008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39f2c210-887b-4041-aa7d-0a2075ebe5b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054118 Nov 19 19:42:19.288994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1007/1951] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:19.369027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:19.377596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7dda91cd-026f-4204-9dbc-caf13e6d4a6a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.117471 Nov 19 19:42:19.378419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 945/1952] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:42:20.204302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:20.205395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:20.216119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:20.216846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:20.218296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:20.218782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:20.255972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3cf69479-7d0e-4c9b-96ac-510075579bcf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055660 Nov 19 19:42:20.257042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1008/1953] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:20.301389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:20.302415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:20.310085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:20.310565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:20.311373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:20.311807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:20.346967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-625f65a8-81f6-47b3-80c8-9a135e3f0e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050078 Nov 19 19:42:20.347546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 946/1954] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:20.395718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:20.396340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:20.403693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:20.404197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:20.405172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:20.405628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:20.474875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:20.487219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ec582aa-1f03-4367-aa70-19a800345c45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094996 Nov 19 19:42:20.488280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1009/1955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:20 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:21.268423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:21.269335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:21.276360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:21.276806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:21.277642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:21.278092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:21.312283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f962bbdb-c25e-4a36-bb29-bcf5cf5e1803 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047606 Nov 19 19:42:21.313062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 947/1956] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:21.359784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:21.360727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:21.369308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:21.370032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:21.371152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:21.371762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:21.406948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b537da7c-56ff-483c-b337-a5aaf01e1ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051007 Nov 19 19:42:21.407575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1010/1957] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:21.514023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:21.514670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:21.522148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:21.522817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:21.523686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:21.524168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:21.592193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:21.601539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a877051c-6467-48a5-87c2-9f47b788e65d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091383 Nov 19 19:42:21.602212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 948/1958] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:22.325238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:22.326212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:22.333315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:22.333762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:22.334753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:22.335175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:22.371840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-18fe3140-8a36-423f-b1e8-bb6d14fa3db5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050635 Nov 19 19:42:22.372840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1011/1959] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:22.423382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:22.424952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:22.436609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:22.437395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:22.438828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:22.439577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:22.478426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0046c2da-47ae-46bf-a823-a631fb54e60e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062189 Nov 19 19:42:22.479093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 949/1960] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:22.629208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:22.629757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:22.637067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:22.637535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:22.638370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:22.638790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:22.709792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:22.719080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ea679571-4d60-4c00-b9ee-1d69f915c224 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093739 Nov 19 19:42:22.719641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1012/1961] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:23.387809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:23.389100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:23.396599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:23.397150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:23.397937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:23.398395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:23.431595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5256fab1-4fef-4edb-9c6a-b61d6a22e05c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048729 Nov 19 19:42:23.432318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 950/1962] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:23.493082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:23.494003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:23.501222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:23.501649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:23.502503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:23.502923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:23.537568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-149f9be1-54e1-4568-ab01-b461e024419a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Nov 19 19:42:23.538361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1013/1963] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:23.736523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:23.737130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:23.743949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:23.744399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:23.745331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:23.745769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:23.811181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:23.819903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a2e20875-49af-4f26-a76c-ed4ad98dae88 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087053 Nov 19 19:42:23.820502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 951/1964] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:24.445074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:24.445942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:24.452922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:24.453355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:24.454222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:24.454681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:24.491328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cc2f0fc5-6283-4ab4-a26a-cfe641ad83ea tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050704 Nov 19 19:42:24.491912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1014/1965] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:24.551633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:24.552585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:24.560436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:24.560950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:24.561826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:24.562452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:24.597922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bb40169f-88d8-43d2-aed8-d9df821384a8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050165 Nov 19 19:42:24.598626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 952/1966] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:24.838152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:24.838830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:24.847189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:24.847655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:24.848467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:24.848900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:24.918266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:24.927014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5f02c938-66e8-4bff-8054-644a3f6315f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093071 Nov 19 19:42:24.927716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1015/1967] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:25.505398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:25.506337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:25.513681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:25.514188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:25.515041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:25.515508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:25.549391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f3da29b8-70d0-499e-896c-2b85e35cec26 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047971 Nov 19 19:42:25.549974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 953/1968] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:25.611231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:25.612380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:25.620067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:25.620695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:25.621716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:25.622322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:25.657422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11b364d5-cc79-49e5-ac24-d0acf68800a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050258 Nov 19 19:42:25.657984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1016/1969] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:25.945414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:25.946008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:25.952965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:25.953449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:25.954306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:25.954749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:26.269068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:26.281098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fefad7b4-7a7a-4a31-9180-e6cadcfdbbf9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.339995 Nov 19 19:42:26.282171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 954/1970] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:26.562343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:26.563176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:26.570413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:26.570861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:26.571646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:26.572097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:26.607707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-30cf9894-b42d-4808-a0f6-01ee4130fcff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049973 Nov 19 19:42:26.608278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1017/1971] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:26.670070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:26.671107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:26.678024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:26.678517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:26.679311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:26.679746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:26.714081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a05704f-0707-49cc-b6a9-e377efbdb2b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048110 Nov 19 19:42:26.714819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 955/1972] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:27.307759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:27.308363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:27.315094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:27.315539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:27.316331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:27.316758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:27.394753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:27.403121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd011eee-1890-45aa-b8e8-450e4b986491 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099160 Nov 19 19:42:27.403689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1018/1973] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:27.620828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:27.621668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:27.628812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:27.629295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:27.630177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:27.630626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:27.663900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e13ec19-bd5f-4a9c-975e-d60a18846c8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047378 Nov 19 19:42:27.664498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 956/1974] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:27.727667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:27.728611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:27.735891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:27.736349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:27.737171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:27.737631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:27.772574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-97657c3c-dee9-4e4c-bc69-25f158ca9316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048785 Nov 19 19:42:27.773192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1019/1975] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:28.424669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:28.425787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:28.435030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:28.435476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:28.436329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:28.436768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:28.520997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:28.534367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a71055c-93c9-4128-84cc-c3e758061551 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.116652 Nov 19 19:42:28.534952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 957/1976] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:28.676585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:28.677524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:28.685617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:28.686149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:28.687026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:28.687511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:28.724592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ec05425-1a6e-4def-8b14-8baf2a411435 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051827 Nov 19 19:42:28.726854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1020/1977] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:28.785005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:28.785858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:28.793392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:28.793845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:28.794680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:28.795823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:28.828948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60824c93-a683-4fdf-852b-3bf548865a86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047956 Nov 19 19:42:28.829532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 958/1978] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:29.553959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:29.554724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:29.561559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:29.562002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:29.562853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:29.563279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:29.631367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:29.643130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f46790eb-64c8-45ff-bdb4-d7e8f1e210e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093582 Nov 19 19:42:29.643703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1021/1979] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:29.738123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:29.739097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:29.746007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:29.746487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:29.747301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:29.747716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:29.782679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-117994f7-276f-4093-ab45-6ba4e526dbbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048408 Nov 19 19:42:29.783297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 959/1980] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:29.841536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:29.842462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:29.850226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:29.850689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:29.851735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:29.852148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:29.887581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-48fbd71d-6dd4-4a9a-ad54-50021cf0ddb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050228 Nov 19 19:42:29.888154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1022/1981] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:30.667192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:30.668456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:30.675060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:30.675512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:30.676335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:30.676779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:30.750133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:30.758604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-83d172fe-4af8-48fe-a473-96f856232b26 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095287 Nov 19 19:42:30.759238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 960/1982] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:30.795206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:30.796195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:30.803486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:30.803963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:30.804975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:30.805402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:30.838749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3e921049-b1f0-4bc7-86cf-a1a65e473ce4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047365 Nov 19 19:42:30.839349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1023/1983] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:30.902178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:30.903129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:30.910086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:30.910688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:30.911678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:30.912216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:30.951072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5601844a-4344-429b-8152-54ccaeefa798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052932 Nov 19 19:42:30.951596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 961/1984] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:31.777111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:31.777728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:31.784596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:31.785038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:31.785826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:31.786293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:31.853224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:31.855286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:31.856750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:31.866513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a9fd01ae-2b11-4343-89d7-9d21ffae6c4a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092955 Nov 19 19:42:31.867531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1024/1985] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:31.868102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:31.868727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:31.869750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:31.870338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:31.907339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7011b13c-4624-4d56-93c3-806f93ccc6f3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059269 Nov 19 19:42:31.907960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 962/1986] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:31.964085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:31.965112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:31.973056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:31.973511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:31.974410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:31.974964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:32.010878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b43ffb42-7b3e-4ed8-983a-b09ffa102399 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051531 Nov 19 19:42:32.011509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1025/1987] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:32.888080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:32.888669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:32.895693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:32.896187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:32.897223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:32.897654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:32.921801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:32.923321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:32.934628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:32.935347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:32.936638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:32.937304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:32.977306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-936d5434-2f5e-4e63-9daf-c56f29e2ba6a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060287 Nov 19 19:42:32.978101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1026/1988] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:32.982265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:32.991557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-18884fbc-6af5-4fad-ad37-d4291f1fd3d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107436 Nov 19 19:42:32.992246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 963/1989] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:33.023000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:33.024075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:33.030725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:33.031227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:33.032209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:33.032740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:33.067353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a4859c42-bf2f-4159-92a0-c9f0626065f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048769 Nov 19 19:42:33.068033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1027/1990] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:33.991771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:33.992775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:34.000102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:34.000544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:34.001331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:34.001772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:34.010624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:34.011628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:34.019083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:34.019537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:34.020372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:34.020810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:34.039268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-da76f45d-217f-4e1e-99e2-bd42c67dca9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051308 Nov 19 19:42:34.040228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 964/1991] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:34.080053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:34.081010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:34.088229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:34.088871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:34.089360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:34.090072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:34.090597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:34.098736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-12b656b1-db7e-4eec-9750-0a14166a4353 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093275 Nov 19 19:42:34.099268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1028/1992] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:42:34.124279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8371221f-a75b-40b2-9bee-3c745654b395 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048014 Nov 19 19:42:34.124872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 965/1993] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:35.052560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:35.053630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:35.061266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:35.061713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:35.062543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:35.062972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:35.098092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-034ea85b-ad3b-47e0-952c-f1f68f7df302 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049241 Nov 19 19:42:35.098576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1029/1994] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:35.120446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:35.121063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:35.127944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:35.128394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:35.129181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:35.129627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:35.136297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:35.137235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:35.151365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:35.151832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:35.153144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:35.154172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:35.197744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:35.206352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f7cf6cb-414b-491e-98b4-704672b588b3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089499 Nov 19 19:42:35.206630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8b2db443-33e1-42e3-8e3c-a76060dd3ed9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073603 Nov 19 19:42:35.207373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 966/1995] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:35.208239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1030/1996] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:36.110849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:36.112081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:36.118933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:36.119522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:36.120532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:36.121658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:36.155922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-08107212-bdf3-454e-bb4e-1f0e676cdf3c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048985 Nov 19 19:42:36.156523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 967/1997] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:36.221094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:36.221992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:36.229468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:36.229910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:36.230745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:36.231173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:36.233553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:36.234414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:36.241887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:36.242547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:36.243465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:36.244006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:36.266376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3f2c9167-03f9-4937-af7d-8566671f882b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049807 Nov 19 19:42:36.267299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1031/1998] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:36.314683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:36.323678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5dbcd515-09aa-4fa9-b3fa-f4748947108d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094380 Nov 19 19:42:36.324278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 968/1999] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:42:37.168827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:37.169655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:37.176630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:37.177082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:37.177930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:37.178620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:37.213217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fa71f8b8-9117-4483-9a67-f3bfeaa4c243 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048378 Nov 19 19:42:37.214391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1032/2000] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:37.281241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:37.282218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:37.289954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:37.290423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:37.291296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:37.291756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:37.327698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8a89c05e-703e-4fd2-a275-6ba3bbab5669 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050627 Nov 19 19:42:37.328284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 969/2001] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:37.340989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:37.341619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:37.349332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:37.349885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:37.350711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:37.351357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:37.424343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:37.432948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ccc53634-ff25-45b3-ae48-b0372da47f8f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095675 Nov 19 19:42:37.433545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1033/2002] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:38.225543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:38.227252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:38.233834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:38.234323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:38.235127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:38.235560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:38.270135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-529ecfb2-fc1f-45ea-9342-b809410cedf0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048572 Nov 19 19:42:38.270739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 970/2003] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:38.340769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:38.341903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:38.350646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:38.351151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:38.352033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:38.352538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:38.388774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f3296e8f-55ff-46ca-bc96-aa5edd90cab8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051977 Nov 19 19:42:38.389410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1034/2004] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:38.455515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:38.456187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:38.463540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:38.463988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:38.464797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:38.465230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:38.533365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:38.542200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6bbd4757-75f6-4906-b571-1785b8958a63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090464 Nov 19 19:42:38.542818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 971/2005] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:39.282635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:39.283764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:39.291148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:39.291651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:39.292550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:39.293013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:39.329414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae585316-4097-43f8-89c5-eeb2f68079e5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050729 Nov 19 19:42:39.330197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1035/2006] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:39.401853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:39.402839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:39.409573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:39.410015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:39.410849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:39.411313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:39.445701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-63a3c7ba-7f9a-4922-a211-f259950892c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047672 Nov 19 19:42:39.446321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 972/2007] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:39.714832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:39.715437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:39.722462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:39.722914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:39.723714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:39.724146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:39.790865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:39.799421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-96e130dc-3d20-4268-ad89-9748ec4225f4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.242809 Nov 19 19:42:39.800112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1036/2008] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:40.341537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:40.342575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:40.350333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:40.351038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:40.351860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:40.352310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:40.387906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8250f1f-4f31-40db-9afa-710ca67cb462 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050560 Nov 19 19:42:40.388491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 973/2009] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:40.457563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:40.458511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:40.465687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:40.466166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:40.466976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:40.467428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:40.501481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0655fcf4-7ef6-419b-8ad2-8c060ef5f851 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047722 Nov 19 19:42:40.502054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1037/2010] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:40.817130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:40.817832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:40.825524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:40.826031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:40.827085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:40.827616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:40.900553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:40.908882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b9db6477-74a5-4982-9a6c-32ebff41811a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095631 Nov 19 19:42:40.909479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 974/2011] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:41.403150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:41.404081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:41.411304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:41.411754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:41.412623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:41.413043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:41.449192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-160114de-92ec-4ec5-9e5f-921571fb3197 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049864 Nov 19 19:42:41.449833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1038/2012] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:41.512931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:41.513766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:41.520709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:41.521153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:41.521995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:41.522423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:41.556430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-94e08bee-3ab6-49fd-a442-0c96f6309b58 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047340 Nov 19 19:42:41.557023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 975/2013] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:41.927258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:41.928071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:41.934783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:41.935403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:41.936194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:41.936644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:42.004185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:42.013708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b8ca1a3-b919-444d-9d29-51b14b22db83 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090182 Nov 19 19:42:42.014354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1039/2014] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:42.464028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:42.465611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:42.476965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:42.477718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:42.479234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:42.480001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:42.534149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5886b38c-cabe-4f6e-97b1-c7dca311196c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076075 Nov 19 19:42:42.534849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 976/2015] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:42.569050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:42.570168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:42.577211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:42.577660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:42.578578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:42.579067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:42.619166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ba2fd02-3cae-4c1b-b4f3-603ad1413073 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054310 Nov 19 19:42:42.619908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1040/2016] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:43.035050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:43.036159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:43.046174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:43.046930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:43.048313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:43.049323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:43.123103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:43.131732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7bece81f-0717-42df-b8d3-397c7624b45e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102967 Nov 19 19:42:43.132443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 977/2017] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:43.549313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:43.550384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:43.557589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:43.558106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:43.558920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:43.559349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:43.596028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8295bb6b-f2d2-4d07-b925-2ab10377ef85 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051020 Nov 19 19:42:43.596747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1041/2018] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:43.630962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:43.632316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:43.639482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:43.639936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:43.640752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:43.641183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:43.677243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8025ea95-3f44-4336-acc5-1e5c57aaaff1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050210 Nov 19 19:42:43.678246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 978/2019] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:44.149887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:44.150539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:44.157321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:44.157787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:44.158624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:44.159061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:44.227615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:44.236002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4da7b7d-4bd2-43ec-84af-5da0cf2be6f2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089970 Nov 19 19:42:44.236558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1042/2020] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:44.608840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:44.609763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:44.616375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:44.616807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:44.617612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:44.618067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:44.651736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f5c4661-7478-45f6-8661-e8a6fc559025 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046750 Nov 19 19:42:44.652444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 979/2021] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:44.689388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:44.690355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:44.697378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:44.697820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:44.698651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:44.699093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:44.739330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cbbc6474-1754-4672-88a6-cdf5b02921f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053661 Nov 19 19:42:44.740360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1043/2022] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:45.254206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:45.255125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:45.262568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:45.262993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:45.263913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:45.264347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:45.348196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:45.356973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88d283b6-04d0-4dca-977e-d85e3584fab1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107242 Nov 19 19:42:45.357609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 980/2023] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:45.664392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:45.665346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:45.672591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:45.673132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:45.674347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:45.674841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:45.710104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d5eebb44-0888-46de-819e-f8a1593599a5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049651 Nov 19 19:42:45.711092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1044/2024] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:45.754684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:45.756113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:45.763707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:45.764344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:45.765310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:45.765794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:45.802274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1b3b6e2-ce13-4b1a-9ac0-63f0d4e232dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051976 Nov 19 19:42:45.802965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 981/2025] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:46.375519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:46.376325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:46.383117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:46.383606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:46.384840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:46.385521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:46.456537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:46.464753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-92727a4f-5864-43b9-a07b-5839ae704951 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094010 Nov 19 19:42:46.465329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1045/2026] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:46.723875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:46.724858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:46.731816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:46.732236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:46.733073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:46.733546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:46.770895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-440c47c0-ba74-4bee-a443-f0a9b7bea660 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051539 Nov 19 19:42:46.771672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 982/2027] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:46.816402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:46.817382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:46.824782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:46.825272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:46.826131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:46.826621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:46.862859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0bc73580-e62a-4c69-93f3-19a1f4881ae0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050316 Nov 19 19:42:46.863437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1046/2028] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:47.482913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:47.483709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:47.490971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:47.491652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:47.492477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:47.492913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:47.564510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:47.573402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-61788bd6-5166-416f-863a-576030b3ef1d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094453 Nov 19 19:42:47.574113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 983/2029] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:47.783326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:47.784347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:47.791369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:47.791941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:47.792843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:47.793328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:47.832176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-462b89e7-d1b5-4faf-a818-5475bc65574b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052702 Nov 19 19:42:47.833273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1047/2030] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:47.876393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:47.877292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:47.887106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:47.887557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:47.888614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:47.889211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:47.926894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-29842766-88fe-4db6-84dd-b16022cdbf44 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055127 Nov 19 19:42:47.928100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 984/2031] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:47 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:48.591811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:48.592323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:48.599329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:48.600043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:48.600617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:48.601047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:48.672553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:48.681119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9bc57666-6d7a-4fbd-8d34-263a22e099a3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093127 Nov 19 19:42:48.681712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1048/2032] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:48.846733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:48.846733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:48.854156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:48.854643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:48.855444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:48.855873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:48.891898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88540c67-1bdb-46ae-ab75-0f6431cb2ac7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050918 Nov 19 19:42:48.892871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 985/2033] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:48.940304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:48.941243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:48.949312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:48.949767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:48.950606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:48.951046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:48.987064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-adde7cac-de43-45c0-9ef4-da04b15bf0dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050631 Nov 19 19:42:48.987734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1049/2034] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:49.705083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:49.705712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:49.713420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:49.714084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:49.715375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:49.715886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:49.782838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:49.791100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7705cdf6-1329-403c-8830-20d8ad963896 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089927 Nov 19 19:42:49.791694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 986/2035] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:49.904524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:49.905505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:49.912959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:49.913502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:49.914467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:49.914946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:49.949649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb870b65-ea56-4541-b7e0-903c4612e86b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049035 Nov 19 19:42:49.950604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1050/2036] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:50.000103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:50.001058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:50.008664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:50.009116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:50.009916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:50.010400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:50.044880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-45c47d85-cbc0-483e-bbcb-40107f839afd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048749 Nov 19 19:42:50.045792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 987/2037] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:50.812767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:50.813907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:50.827389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:50.828084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:50.829394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:50.830253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:50.931771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:50.940008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61634d1b-303b-49c6-a40c-fbb85891906e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.134308 Nov 19 19:42:50.940611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1051/2038] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:50.965346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:50.967139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:50.977580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:50.978302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:50.979350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:50.979976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:51.016680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a22ca9ba-27ca-440b-91db-86cb09057cb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058104 Nov 19 19:42:51.017578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 988/2039] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:51.061362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:51.063051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:51.074263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:51.074961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:51.075932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:51.076521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:51.115164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62067c3a-1474-4e4a-b13a-9b5016d25895 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060737 Nov 19 19:42:51.116776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1052/2040] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:51.961966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:51.962767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:51.970344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:51.970796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:51.971839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:51.972276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:52.030236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:52.031313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:52.039217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:52.039812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:52.041646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:52.041784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:52.045374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:52.058310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20a629f5-3ea0-42f1-8ffd-35686cac59b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100475 Nov 19 19:42:52.059286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 989/2041] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:52.089830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef687d3f-07be-4f55-b105-c41a8783a427 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063997 Nov 19 19:42:52.090533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1053/2042] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:52.128751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:52.129714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:52.137350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:52.137847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:52.138784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:52.139256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:52.173578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88bfb5de-220c-4723-9b0b-b3395d4aacf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048835 Nov 19 19:42:52.174190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 990/2043] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:52 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:53.083985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:53.084997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:53.092143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:53.093315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:53.093732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:53.094206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:53.103139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:53.104051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:53.112558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:53.113279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:53.114626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:53.115473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:53.149698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b4008135-2ff6-4d06-b1e8-d3a90cbd4845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050840 Nov 19 19:42:53.150338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 991/2044] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:42:53.173544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:53.181921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c68ea273-f0ff-4286-a750-d7f8256b07c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101748 Nov 19 19:42:53.182555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1054/2045] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:53.191888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:53.193538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:53.204253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:53.205093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:53.206590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:53.207371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:53.245085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e3f4f8cb-07c2-4c23-9cf5-1c392b6cac15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061828 Nov 19 19:42:53.245695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 992/2046] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:54.162855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:54.163948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:54.170962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:54.171402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:54.172204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:54.172639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:54.202113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:54.203347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:54.207859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9c4c6825-0d36-4855-afed-12a28a94746f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049270 Nov 19 19:42:54.208714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1055/2047] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:54.215569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:54.216315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:54.218030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:54.218801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:54.261258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:54.262282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:54.269005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:54.269440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:54.270321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:54.270761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:54.307867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a65295c5-f74e-4cc9-85ed-098ef3b59991 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053669 Nov 19 19:42:54.308545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1056/2048] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:42:54.317474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:54.331886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-44c24821-addd-4176-9174-9fbf713b2875 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.136029 Nov 19 19:42:54.332962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 993/2049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:42:55.220176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:55.221037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:55.228796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:55.229301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:55.230213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:55.230665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:55.268159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a369fb22-c4fd-437b-b42f-f08951eda513 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052368 Nov 19 19:42:55.268938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1057/2050] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:55.321488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:55.322443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:55.329863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:55.330414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:55.331285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:55.331750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:55.360930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:55.361990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:55.368654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3193e2d1-6826-4a86-94d0-14acb8172e38 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051986 Nov 19 19:42:55.369217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 994/2051] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:55.373131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:55.373897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:55.375385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:55.376158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:55.453301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:55.462633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-941065cc-8e61-497d-a89d-a95265665666 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.108495 Nov 19 19:42:55.463329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1058/2052] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:56.281107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:56.282017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:56.288989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:56.289431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:56.290275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:56.290691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:56.326103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7c3b9b1a-79c3-4ef9-8ba2-ed44a19e64ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048858 Nov 19 19:42:56.326877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 995/2053] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:56.381419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:56.382607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:56.390266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:56.390716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:56.391511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:56.391947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:56.434396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-13cb06a6-1f8e-488b-b6f8-7d964ae4367b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057115 Nov 19 19:42:56.434970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1059/2054] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:56.481340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:56.481976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:56.489291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:56.489738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:56.490722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:56.491200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:56.569409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:56.577310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3b931ac-b1aa-481c-a249-62f99712a552 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099718 Nov 19 19:42:56.577912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 996/2055] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:57.340464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:57.341501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:57.349036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:57.349784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:57.350725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:57.351159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:57.385670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de18893d-c70e-47f1-8764-035fb325ecca tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049360 Nov 19 19:42:57.386609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1060/2056] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:57.446165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:57.447201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:57.454317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:57.454842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:57.455687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:57.456149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:57.496131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f6d3b90a-cde7-424e-bdcd-8acd210d3729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054166 Nov 19 19:42:57.496714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 997/2057] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:57 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:57.595878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:57.596397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:57.603490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:57.603936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:57.604741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:57.605173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:57.681247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:57.689201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d9aa88d-ad41-40c0-822c-42bee259d462 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097641 Nov 19 19:42:57.689950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1061/2058] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:58.397593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:58.398702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:58.405686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:58.406311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:58.407452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:58.407936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:58.445037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f700c748-2480-431f-b3a5-865135611e7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051641 Nov 19 19:42:58.445639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 998/2059] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:58.510091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:58.510945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:58.518593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:58.519042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:58.519850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:58.520290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:58.555036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1ea77ea-9e41-42a4-b6c5-961a81948ff0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050010 Nov 19 19:42:58.555630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1062/2060] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:58.708058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:58.710881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:58.721656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:58.722110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:58.722931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:58.723389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:58.791425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:58.799959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4c4acc1b-6f31-4369-a252-cacd3811a184 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095726 Nov 19 19:42:58.800549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 999/2061] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:42:59.456785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:59.457728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:59.464922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:59.465360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:59.466230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:59.466647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:59.501773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1bf930a2-ba7c-4a7a-b820-dd54ad94f989 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048808 Nov 19 19:42:59.502418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1063/2062] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:42:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:42:59.567871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:59.568756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:59.577018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:59.577692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:59.578530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:59.578999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:59.615450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c79a4e73-26bc-4fd6-8303-0ca95970ac77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051960 Nov 19 19:42:59.616140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1000/2063] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:42:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:42:59.825030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:42:59.826033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:42:59.838406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:59.839203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:59.840525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:42:59.841171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:42:59.910700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:42:59.919337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4df42d82-2ab2-4b4d-a3f7-b155433674ea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101188 Nov 19 19:42:59.919929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1064/2064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:42:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:00.517026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:00.518082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:00.527223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:00.527763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:00.528698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:00.529171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:00.565775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7e8b685-f157-4308-bfbc-b6c0e30a47cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052952 Nov 19 19:43:00.566405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1001/2065] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:00.629385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:00.630366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:00.637409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:00.637830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:00.638721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:00.639158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:00.673225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e07a6e1b-88bf-433e-bc57-b45edd3d1d1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047781 Nov 19 19:43:00.674115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1065/2066] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:00.937297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:00.937930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:00.945472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:00.945917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:00.946766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:00.947207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:01.045117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:01.053646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-af6d03dd-4179-42ee-a202-25da89577dac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.119906 Nov 19 19:43:01.054279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1002/2067] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:01.580347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:01.581186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:01.591113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:01.591881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:01.593680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:01.594483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:01.639221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19c3feff-2d8d-4006-9609-007a124d5538 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063380 Nov 19 19:43:01.639856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1066/2068] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:01.686222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:01.687586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:01.696032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:01.696488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:01.697302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:01.697746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:01.742031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-64b15b76-aaa7-4fd1-89e5-77a1aa403e6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060175 Nov 19 19:43:01.742742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1003/2069] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:02.077315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:02.077964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:02.085069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:02.085520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:02.086362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:02.086801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:02.156197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:02.164792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4064ddaa-846f-49b3-8da2-8c11111524e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091304 Nov 19 19:43:02.165388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1067/2070] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:43:02.652503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:02.653440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:02.660404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:02.660875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:02.661850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:02.662555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:02.697466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f3281e66-e662-4664-8d03-da50455894e7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049036 Nov 19 19:43:02.698277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1004/2071] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:02.757746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:02.759126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:02.767027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:02.767535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:02.768521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:02.768989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:02.803386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19783d8e-3df3-4bf0-9d2c-f98f8190e330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051829 Nov 19 19:43:02.804075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1068/2072] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:03.186460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:03.187574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:03.196045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:03.196489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:03.197288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:03.197719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:03.264181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:03.273119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d0869b62-b19e-4415-9526-d2eb0cf8b556 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093578 Nov 19 19:43:03.273829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1005/2073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:03.710075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:03.711098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:03.719146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:03.719660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:03.720535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:03.721034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:03.755952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f41b0252-6d87-4d02-b228-3149c91fce21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049976 Nov 19 19:43:03.756555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1069/2074] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:03.815269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:03.816199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:03.823873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:03.824317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:03.825112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:03.825545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:03.860821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-269016bd-f87f-4668-8f14-314b00daab61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049422 Nov 19 19:43:03.861840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1006/2075] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:03 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:04.294732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:04.295738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:04.303880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:04.304348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:04.305167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:04.305609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:04.377771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:04.387232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1cae4377-0fe9-4cd4-bddf-8d1e7c03fc7b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099443 Nov 19 19:43:04.387822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1070/2076] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:04.769282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:04.770918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:04.778551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:04.779001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:04.779811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:04.780244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:04.814381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-08b9df42-46d4-4a1c-8caf-9bc538ca4f8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049974 Nov 19 19:43:04.814993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1007/2077] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:04.873139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:04.874502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:04.881601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:04.882170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:04.882972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:04.883396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:04.916671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b46d0e5-51bb-4fdd-a4f4-415e91220344 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047302 Nov 19 19:43:04.917435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1071/2078] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:05.405009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:05.405650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:05.413390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:05.413748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:05.414629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:05.415063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:05.483813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:05.493794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89d29bce-a6d8-48aa-b097-8357c6d30176 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092521 Nov 19 19:43:05.494471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1008/2079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:05.826993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:05.827901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:05.835205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:05.835694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:05.836503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:05.836992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:05.871950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0496d6c1-28b9-49b0-95cd-e34da6082781 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048659 Nov 19 19:43:05.872646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1072/2080] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:05.930507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:05.931502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:05.938436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:05.938894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:05.939691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:05.940139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:05.994693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d98a8b41-6e31-4159-8f0e-0e5d925b9dde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068879 Nov 19 19:43:05.995827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1009/2081] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:06.510786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:06.511272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:06.518613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:06.519060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:06.519863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:06.520296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:06.589230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:06.598449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5efdc9ad-4536-49b9-9580-bad15ccae734 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091383 Nov 19 19:43:06.599026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1073/2082] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:06.883549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:06.884475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:06.891284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:06.891742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:06.892542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:06.892973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:06.927682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-19933fb1-a309-44cd-9844-860561a2bc30 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047996 Nov 19 19:43:06.928615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1010/2083] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:07.009680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:07.010628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:07.017821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:07.018291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:07.019080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:07.019505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:07.053131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35bf5d49-5ec7-43b1-ad71-e2252c60afa0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047789 Nov 19 19:43:07.054086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1074/2084] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:07.617016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:07.617649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:07.626435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:07.627652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:07.628315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:07.628843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:07.696077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:07.704422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f6de83f7-719a-4647-ac51-c5d000f63883 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091660 Nov 19 19:43:07.705011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1011/2085] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:07.945148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:07.946713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:07.956860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:07.957668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:07.960072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:07.960863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:07.998148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-249a97b8-73b6-4d81-bc83-6859ce183518 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061294 Nov 19 19:43:07.998830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1075/2086] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:08.064836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:08.065767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:08.072937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:08.073381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:08.074219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:08.074639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:08.110285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e0219d2b-d750-46b1-8d5e-f64cbd9ded51 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049214 Nov 19 19:43:08.110886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1012/2087] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:08.723014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:08.723864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:08.732281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:08.732874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:08.733751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:08.734304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:08.801107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:08.810213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5fdcea25-7fab-496d-95c5-26510af4e844 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091041 Nov 19 19:43:08.810865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1076/2088] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:09.016221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:09.019161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:09.029153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:09.029975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:09.031931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:09.032860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:09.095881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e9b11af0-172c-419d-932d-b25e1f5be8f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.086935 Nov 19 19:43:09.097407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1013/2089] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:09.125384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:09.126839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:09.138004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:09.138751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:09.140070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:09.140633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:09.199723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ea2b430d-3b6c-4d8f-865e-afde0cc7a08e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080437 Nov 19 19:43:09.200625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1077/2090] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:09.827901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:09.828432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:09.835296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:09.835745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:09.836536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:09.836966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:09.903097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:09.913453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-840452c6-cebc-4504-850a-e2b53cc2536f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088864 Nov 19 19:43:09.914536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1014/2091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:10.109357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:10.110213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:10.117741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:10.118217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:10.119007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:10.119445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:10.152645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fde5ee95-3868-4024-9c04-9ffdab9059c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047152 Nov 19 19:43:10.153243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1078/2092] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:10.213058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:10.213993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:10.221592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:10.222080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:10.222923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:10.223360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:10.258255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f997344d-db40-4f83-b332-94bab898b5d3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049377 Nov 19 19:43:10.258835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1015/2093] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:10.939277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:10.939892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:10.947393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:10.947822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:10.948635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:10.949072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:11.023220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:11.031598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1db8daf-8f7d-4c8b-9acb-c80f8601c060 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096207 Nov 19 19:43:11.032226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1079/2094] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:11.165113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:11.165989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:11.173159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:11.173610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:11.174478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:11.174965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:11.209816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9f0f33a-2e1d-4562-8d0c-e3f6d2904a51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048724 Nov 19 19:43:11.210449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1016/2095] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:11.271239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:11.272232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:11.280335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:11.280776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:11.281677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:11.282198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:11.317867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-44a2a9c2-06d2-42b7-a371-2732127f7f3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050891 Nov 19 19:43:11.318839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1080/2096] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:12.050011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:12.050774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:12.058502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:12.059028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:12.060024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:12.060622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:12.131370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:12.140336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7525c514-7968-464d-b920-0fb11a92437a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094247 Nov 19 19:43:12.140911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1017/2097] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:12.223319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:12.224486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:12.231810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:12.232256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:12.233052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:12.233478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:12.268981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-81e712a9-68a4-406b-9895-f53bc968dab2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049792 Nov 19 19:43:12.269717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1081/2098] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:12.331617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:12.332534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:12.340443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:12.340885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:12.341687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:12.342170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:12.378093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b59950d-8ced-4f25-8751-4a7783f3ce0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050436 Nov 19 19:43:12.378695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1018/2099] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:12 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:43:13.159578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:13.160168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:13.167279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:13.167717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:13.168505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:13.168928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:13.239587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:13.248331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7713f54c-55bd-4c82-b2c0-5e07ca614e3a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093238 Nov 19 19:43:13.248934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1082/2100] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:13.282501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:13.283431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:13.291452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:13.291965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:13.292881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:13.293328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:13.329643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b7201298-2ba7-4666-b645-9924fbf8ebef tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051565 Nov 19 19:43:13.330420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1019/2101] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:13.391551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:13.392477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:13.399740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:13.400182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:13.400973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:13.401443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:13.434506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e19ec645-33f7-4dc1-9bbf-5d50d378a0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046600 Nov 19 19:43:13.435024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1083/2102] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:14.268927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:14.269608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:14.276818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:14.277295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:14.278096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:14.278552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:14.343995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:14.345217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:14.346991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:14.354704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:14.355240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:14.356290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:14.356786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:14.359560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9c191a81-e9d5-483a-873b-5b3704b71094 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094337 Nov 19 19:43:14.360579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1020/2103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:14 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:14.401823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cf809a8f-3909-47a1-82cc-9fec37c68692 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062704 Nov 19 19:43:14.402440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1084/2104] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:14.445932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:14.446903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:14.453956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:14.454458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:14.455224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:14.455670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:14.494755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8df7757-5976-4378-a8a2-ff34c18b0cae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052878 Nov 19 19:43:14.495353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1021/2105] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:15.383507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:15.384553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:15.397332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:15.399226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:15.401706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:15.404454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:15.418008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:15.419403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:15.427271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:15.427967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:15.429007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:15.429514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:15.479120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5ba602d-58a8-4764-b15a-90b28b19f12b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066321 Nov 19 19:43:15.480198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1022/2106] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:15.495670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:15.503719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb833731-e2cb-4119-90e5-5bca23ed8dab tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.128519 Nov 19 19:43:15.504410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1085/2107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:15.509810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:15.510852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:15.517581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:15.518035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:15.519074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:15.519520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:15.552634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cdeb8808-d0bb-439f-bf27-70e42cb47486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046997 Nov 19 19:43:15.553235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1023/2108] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:16.494166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:16.495106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:16.502498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:16.503129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:16.504187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:16.504654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:16.524917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:16.526132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:16.536860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:16.537566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:16.538906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:16.539569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:16.553338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-613c6827-8aaa-496b-906f-35587de10b73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063112 Nov 19 19:43:16.554358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1086/2109] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:16.567781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:16.569357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:16.579398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:16.580071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:16.581365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:16.582100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:16.627612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:16.636635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84b6e86e-c078-4bd3-8448-0d8874f43371 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.118018 Nov 19 19:43:16.637237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1024/2110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:16.638386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8e97292-b59e-44ca-86ee-f1e365d915fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076111 Nov 19 19:43:16.639439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1087/2111] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:43:17.566947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:17.568021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:17.575976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:17.576399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:17.577244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:17.577676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:17.613081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-25700ba6-8349-47b0-8bb3-749f5ca99cde tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050281 Nov 19 19:43:17.613758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1025/2112] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:17.653437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:17.654833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:17.655034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:17.655627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:17.662830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:17.663167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:17.663478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:17.663644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:17.664265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:17.664735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:17.664917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:17.665336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:17.701943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dfcc3a89-54d2-4047-afe4-05d29f4df4da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052383 Nov 19 19:43:17.703019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1088/2113] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:17 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:43:17.738084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:17.746518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bc0eb710-36af-4367-84b5-886a28fb1fc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095692 Nov 19 19:43:17.747112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1026/2114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:43:18.625991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:18.626902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:18.634764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:18.635237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:18.636008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:18.636488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:18.671521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0154e9c9-7ecf-40a0-a511-212a09c41759 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049448 Nov 19 19:43:18.672335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1089/2115] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:18.714944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:18.716249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:18.723945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:18.724451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:18.725302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:18.725777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:18.761420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e9291ea6-33a6-4552-b0f2-d98ed49bd380 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050339 Nov 19 19:43:18.762216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1027/2116] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:18.767761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:18.768505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:18.775812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:18.776315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:18.777226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:18.777702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:18.851866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:18.860016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d1e1b14-e88c-40f9-b83d-5fd3dac48626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098586 Nov 19 19:43:18.860612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1090/2117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:19.686068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:19.687033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:19.694745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:19.695196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:19.696013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:19.696447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:19.743271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9c45a1a7-b8a9-4385-a813-37528db4a121 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061097 Nov 19 19:43:19.744080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1028/2118] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:19.776017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:19.776988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:19.784175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:19.784653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:19.785545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:19.786039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:19.821082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4aa45604-dbdd-4d6d-bb0a-e601e1134cc6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049092 Nov 19 19:43:19.821668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1091/2119] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:19.885290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:19.885916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:19.892971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:19.893450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:19.894297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:19.894726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:19.962189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:19.971021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eab18c33-345d-498a-86a1-a613f906a165 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089592 Nov 19 19:43:19.971615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1029/2120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:20.758790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:20.759744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:20.766657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:20.767076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:20.767905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:20.768331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:20.804943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e2ebc8e8-0a26-41e6-8351-2d008da21797 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051013 Nov 19 19:43:20.805790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1092/2121] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:20.835882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:20.836876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:20.844413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:20.844861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:20.845695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:20.846246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:20.883861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bcb581e8-9e9a-4f99-8eb8-8b782716102c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052354 Nov 19 19:43:20.884441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1030/2122] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:20.988752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:20.989517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:20.997202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:20.997642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:20.998501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:20.998928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:21.072331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:21.085813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c01935d8-2e29-49ff-ac6f-3da7440089d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100611 Nov 19 19:43:21.086861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1093/2123] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:20 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:21.817823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:21.818855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:21.825750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:21.826247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:21.827039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:21.827474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:21.862458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46f57184-4c66-4ed1-a245-0eedc900bad2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048856 Nov 19 19:43:21.863221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1031/2124] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:21.898009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:21.899075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:21.906439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:21.906884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:21.907671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:21.908099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:21.942810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-235e8501-e0ab-4ca4-8218-b307b2528ca5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048686 Nov 19 19:43:21.943789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1094/2125] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:22.112354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:22.112945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:22.120265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:22.120707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:22.121493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:22.121944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:22.210314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:22.219629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2338039-15bd-4fad-b41e-b8d5e0e6ba9c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.111484 Nov 19 19:43:22.220208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1032/2126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:22.875278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:22.876331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:22.883646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:22.884202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:22.885193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:22.885744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:22.920595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e2aee57c-529b-42dc-a013-bd6f205a5845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049285 Nov 19 19:43:22.921410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1095/2127] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:22.955892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:22.957250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:22.964668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:22.965103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:22.965898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:22.966357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:23.002798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cb54091e-eaac-4b03-8182-24a2d2d509e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050781 Nov 19 19:43:23.003481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1033/2128] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:23.238254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:23.239031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:23.246643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:23.247282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:23.248266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:23.248799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:23.320828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:23.333484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2647865d-ad91-4846-a925-db52be39bfde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098565 Nov 19 19:43:23.334426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1096/2129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:23.932863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:23.934226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:23.941627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:23.942336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:23.943366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:23.943945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:23.978945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ab30581-17c8-4210-a01e-e192fdd8da0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049814 Nov 19 19:43:23.979945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1034/2130] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:24.016207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:24.017170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:24.024574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:24.025080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:24.026587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:24.027027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:24.060658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e3cf9af8-fb55-47b6-ad75-44ab9f51535b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048274 Nov 19 19:43:24.061222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1097/2131] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:24.353754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:24.354425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:24.361635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:24.362104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:24.362915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:24.363350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:24.444026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:24.452330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-145f8931-36e0-45c2-81cb-cae521a74492 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102626 Nov 19 19:43:24.453039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1035/2132] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:24.992829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:24.993762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:25.000033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:25.000479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:25.001250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:25.001674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:25.034703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-250c45c7-8e93-4bb7-8a7d-ee6b8e62a452 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045948 Nov 19 19:43:25.035629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1098/2133] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:25.073585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:25.074555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:25.081474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:25.081924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:25.083213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:25.083658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:25.117613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7abfa6fe-8698-4bd6-968e-68c2c345da73 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048841 Nov 19 19:43:25.117918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1036/2134] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:25.470424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:25.470941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:25.478036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:25.478540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:25.479380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:25.479805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:25.547344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:25.556345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-96520946-4eb4-441c-825e-5b2c97eadae4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090096 Nov 19 19:43:25.556938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1099/2135] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:26.047848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:26.048803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:26.055756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:26.056205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:26.056996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:26.057427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:26.092494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79fdd3d7-1d09-495c-931c-95080749b9c9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048413 Nov 19 19:43:26.093568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1037/2136] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:26.129529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:26.130617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:26.138239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:26.138838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:26.139829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:26.140374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:26.176110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ef87866-fa9e-49d9-9ead-94090c7d93cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050452 Nov 19 19:43:26.176726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1100/2137] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:26.574011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:26.574645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:26.581575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:26.582076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:26.582901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:26.583381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:26.655477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:26.664760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f067832d-dfd1-4c99-99c3-07fdbb123dcb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094528 Nov 19 19:43:26.665345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1038/2138] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:27.105452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:27.106391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:27.113249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:27.113695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:27.114721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:27.115441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:27.150665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e5da5cc-a225-4447-94fc-5cc62ea826a4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048714 Nov 19 19:43:27.151477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1101/2139] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:27.188766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:27.189754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:27.196835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:27.197273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:27.198081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:27.198509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:27.234943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2797f143-c982-4260-bf02-73df64e8ce83 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050057 Nov 19 19:43:27.235661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1039/2140] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:27.688920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:27.689609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:27.697253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:27.697697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:27.698536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:27.698962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:27.768939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:27.778709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d5edd1b-70e5-4dee-887b-7e8bf45c6673 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093369 Nov 19 19:43:27.779350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1102/2141] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:28.164922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:28.166069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:28.173158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:28.173646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:28.174618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:28.175087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:28.210490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-67fda237-ca2e-4b95-a874-8dcb205a4529 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050154 Nov 19 19:43:28.211531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1040/2142] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:28.247404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:28.248486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:28.256423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:28.256862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:28.257870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:28.258444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:28.302996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6f4a05ba-9487-490a-abe5-3b94c11bf367 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058325 Nov 19 19:43:28.304033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1103/2143] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:28.798523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:28.799306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:28.807921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:28.808528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:28.809393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:28.809826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:28.882200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:28.890835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b624e5b1-2df1-4702-9761-e5ef924c1029 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097575 Nov 19 19:43:28.891652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1041/2144] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:29.225797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:29.226812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:29.234428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:29.234882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:29.235812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:29.236318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:29.275493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0208d5db-68a6-45c7-996f-6877d8a2b15f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053824 Nov 19 19:43:29.276452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1104/2145] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:29.318025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:29.319355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:29.326794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:29.327302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:29.328110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:29.328610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:29.365133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5214d5a7-2fe1-4e37-8ed4-eab105fb0c94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051124 Nov 19 19:43:29.365921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1042/2146] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:29.908936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:29.909551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:29.917144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:29.917595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:29.918440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:29.918871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:29.984865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:29.994123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4f7fed5e-4ff5-489e-bbf9-783d8f0ced0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088949 Nov 19 19:43:29.994880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1105/2147] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:30.289118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:30.290142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:30.297530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:30.298311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:30.299126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:30.299558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:30.334726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-54b460df-b5fe-4901-95f9-ea7b8ef7b823 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050118 Nov 19 19:43:30.335494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1043/2148] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:30.378197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:30.379197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:30.387365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:30.387813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:30.388613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:30.389046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:30.440647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ca3343c8-28c4-4830-a3d7-187b488e3ff5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066372 Nov 19 19:43:30.441647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1106/2149] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:31.012120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:31.012866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:31.020050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:31.020618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:31.021812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:31.022284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:31.091921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:31.100900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d9b95ee2-fe16-4e7e-97af-608680c1737c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092657 Nov 19 19:43:31.101577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1044/2150] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:31.347438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:31.348397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:31.355889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:31.356331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:31.357142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:31.357575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:31.397603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c17b4dbe-cdb7-4c48-bdc3-d58d6d17993d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054317 Nov 19 19:43:31.398404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1107/2151] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:31.456180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:31.457478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:31.466120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:31.466716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:31.467629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:31.468526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:31.504165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef4492dd-5e35-45f0-8fcc-af6be37c88e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051983 Nov 19 19:43:31.504718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1045/2152] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:32.118614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:32.119257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:32.126094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:32.126523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:32.127325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:32.127751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:32.196017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:32.204422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-363b5c81-b5c1-45cc-b994-2a5d1a49068e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089664 Nov 19 19:43:32.205050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1108/2153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:32.410416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:32.411367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:32.418992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:32.419442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:32.420268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:32.420713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:32.455947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03636033-2b63-48a3-a6d5-75798a6ab3da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049619 Nov 19 19:43:32.456545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1046/2154] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:32.516380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:32.517297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:32.524364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:32.524803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:32.525588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:32.526011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:32.560098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bf690df8-eb65-4047-989a-c8935d77327a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047488 Nov 19 19:43:32.560687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1109/2155] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:33.222703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:33.223211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:33.230443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:33.230893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:33.231692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:33.232119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:33.298818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:33.307284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e06dd45b-b4ed-4357-ac9e-3ff2f4e1cfb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088486 Nov 19 19:43:33.308026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1047/2156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:33.469004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:33.469967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:33.478066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:33.478440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:33.479677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:33.480293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:33.516301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-24e319ab-0cc2-44ea-baf8-00b368e85e1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051546 Nov 19 19:43:33.516904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1110/2157] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:33.572466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:33.573386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:33.580671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:33.581116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:33.581909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:33.582382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:33.630481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2a18794c-3ac2-496a-b070-c8c02404db84 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061613 Nov 19 19:43:33.631560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1048/2158] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:34.325042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:34.325639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:34.333205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:34.333470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:34.334385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:34.334849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:34.404344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:34.413336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-56ce2f9a-f6b8-4a5a-a07c-536c86c0a08a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091893 Nov 19 19:43:34.413912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1111/2159] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:34.529146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:34.530112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:34.537833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:34.538371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:34.539223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:34.539774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:34.576350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e9cc1af9-ca02-4466-b4fb-a65fb93f5125 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051200 Nov 19 19:43:34.577137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1049/2160] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:34.646436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:34.647484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:34.654573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:34.655050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:34.655853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:34.656285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:34.697422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-980881cd-1ee9-4321-aebc-c5fcc27c9ebf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055003 Nov 19 19:43:34.698371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1112/2161] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:35.430983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:35.431611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:35.438676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:35.439135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:35.439941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:35.440379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:35.529471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:35.538188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9a1e8ce5-a70f-467d-be70-6649c18de971 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.110939 Nov 19 19:43:35.538766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1050/2162] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:35.589536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:35.590694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:35.599516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:35.599969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:35.600784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:35.601221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:35.639256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35bc7c8f-9858-4d5a-ae37-08b332d5d05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054232 Nov 19 19:43:35.639831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1113/2163] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:35.709990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:35.710971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:35.718393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:35.718949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:35.719776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:35.720218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:35.755385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5df8246a-dde4-4658-9f36-869fb4257db3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049323 Nov 19 19:43:35.755990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1051/2164] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:36.565147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:36.565935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:36.572748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:36.573211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:36.573982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:36.574470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:36.642783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:36.652024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-86598135-5b4b-43e3-8694-89536cffb121 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090815 Nov 19 19:43:36.652464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:36.653168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1114/2165] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:36.653474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:36.661135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:36.661867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:36.662870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:36.663310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:36.699647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-987074cf-ec07-45f2-b654-bfa2455b873d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050902 Nov 19 19:43:36.700222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1052/2166] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:36.768094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:36.769108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:36.776996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:36.777570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:36.778464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:36.778933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:36.816923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-23c4881f-e4ff-46aa-ac60-c0eb51c917b4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052630 Nov 19 19:43:36.818452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1115/2167] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:37.670559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:37.671153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:37.678257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:37.678849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:37.679741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:37.680380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:37.716027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:37.718032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:37.731061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:37.731840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:37.733251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:37.734075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:37.753307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:37.762403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-067cfd05-c607-4173-8c31-efb96db4780a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095586 Nov 19 19:43:37.763278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1053/2168] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:37.782851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3af5336-c7f3-407c-b004-5ea101cfdb7d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074436 Nov 19 19:43:37.783448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1116/2169] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:37.829692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:37.830706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:37.837646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:37.838085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:37.838928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:37.839353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:37.875707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-43b7c05e-8815-43e9-861e-8499362ae51f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049829 Nov 19 19:43:37.876294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1054/2170] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:38.780152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:38.781179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:38.789929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:38.790435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:38.791312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:38.791816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:38.795792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:38.796783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:38.803675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:38.804106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:38.804905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:38.805332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:38.844810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-117666e2-6d59-4bf6-af3c-ec9492be1746 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053132 Nov 19 19:43:38.845526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1055/2171] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:38.860248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:38.869720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1bc89e7-b880-4e6f-9d5e-4482627c7874 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093755 Nov 19 19:43:38.870350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1117/2172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:38.889367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:38.890573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:38.897885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:38.898357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:38.899140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:38.899564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:38.933000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7dc29a0e-a4cf-4519-a6f6-5d559a7b6881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047632 Nov 19 19:43:38.933558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1056/2173] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 19:43:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:43:39.858525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:39.859445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:39.866725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:39.867198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:39.868000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:39.868434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:39.891718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:39.892803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:39.902476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-261d1fe3-a5f2-46b4-a84f-ee096f2b42ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047878 Nov 19 19:43:39.902843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:39.909049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1118/2174] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:39.909353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:39.909353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:39.909353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:39.945700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:43:39.946692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:39.956501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:39.957114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:39.958115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:39.958607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:39.990384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:40.000312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fded9b1e-5a2e-4ff2-aed3-351f245116f6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.115534 Nov 19 19:43:40.001006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1057/2175] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:43:40.063356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5af45914-56aa-4744-a32f-ea731f0650a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action" status: 200 len: 76315 microversion: 2.1 time: 0.121764 Nov 19 19:43:40.064144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1119/2176] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:43:39 2021] POST /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26/action => generated 76315 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:40.917563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:40.918536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:40.925612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:40.926079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:40.927002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:40.927433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:40.961349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-31f22513-8ebe-4060-be67-a71d55d32a42 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047781 Nov 19 19:43:40.962013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1058/2177] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:41.020141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:41.021165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:41.029335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:41.029879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:41.030799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:41.031268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:41.100694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:41.109924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f837a9fc-22e2-4e59-a3f0-93e01654b3a6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094035 Nov 19 19:43:41.110569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1120/2178] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:41.973804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:41.974782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:41.983433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:41.984177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:41.985597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:41.986419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:42.046038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-849c6cd4-2307-4c9b-ac0f-3d0c8e912e52 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075898 Nov 19 19:43:42.047093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1059/2179] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:42.127091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:42.127761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:42.135645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:42.136134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:42.137089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:42.137523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:42.204682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:42.213761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f613f27-d4b7-441c-87fa-1c633d473d80 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090390 Nov 19 19:43:42.214437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1121/2180] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:43.059428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:43.060337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:43.067958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:43.068405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:43.069205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:43.069632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:43.104603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e93f618-849e-4af8-821b-783d20c13327 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049086 Nov 19 19:43:43.105169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1060/2181] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:43.232513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:43.233390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:43.241177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:43.241619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:43.242436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:43.242876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:43.311474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:43.325250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dce5072c-3289-4a9c-9572-2e0e13912199 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096248 Nov 19 19:43:43.326237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1122/2182] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:44.116558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:44.117613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:44.124947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:44.125469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:44.126367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:44.126830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:44.161989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbd6ce46-b2d1-4046-b193-16e234566b5c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049522 Nov 19 19:43:44.162636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1061/2183] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:44.350737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:44.352920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:44.359607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:44.360051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:44.360854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:44.361290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:44.443143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:44.452901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-21a38bd8-3cc8-4046-91ff-e255dda1c27e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.106549 Nov 19 19:43:44.453503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1123/2184] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:45.174285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:45.175225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:45.182652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:45.183101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:45.183896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:45.184324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:45.218711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9eb4fb9-3037-40c1-8e92-e5a4a291cc1e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048220 Nov 19 19:43:45.219298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1062/2185] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:45.471456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:45.472113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:45.479990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:45.480443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:45.481248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:45.481685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:45.548760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:45.557713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-154a5e67-c956-4fc4-b2a4-e9e11042db3b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090334 Nov 19 19:43:45.558355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1124/2186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:46.231227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:46.232179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:46.239527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:46.240019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:46.240836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:46.241241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:46.274616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84004b6e-ee26-46aa-be08-03f32f4c6ec3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047259 Nov 19 19:43:46.275206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1063/2187] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:46.577384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:46.578407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:46.586333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:46.586793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:46.587588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:46.588019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:46.653508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:46.662202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-381ed557-10d5-4ad2-8b00-1cd85ec3ee7d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088581 Nov 19 19:43:46.662875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1125/2188] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:47.287024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:47.287960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:47.295536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:47.295986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:47.296814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:47.297246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:47.331593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-302c3e57-b4c8-45e1-85eb-cc89c63ad716 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048606 Nov 19 19:43:47.332526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1064/2189] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:47.680487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:47.681247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:47.689083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:47.689527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:47.690495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:47.690938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:47.760280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:47.769455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3e234aa8-1683-44f9-ae9a-2c903148c3af tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092962 Nov 19 19:43:47.770264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1126/2190] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:43:48.344114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:48.345065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:48.352738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:48.353204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:48.353993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:48.354490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:48.389628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b92ead4b-1982-49ea-89c5-277fa9284476 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049788 Nov 19 19:43:48.390381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1065/2191] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:48.788884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:48.789518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:48.796653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:48.797097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:48.797886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:48.798352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:48.879164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:48.891436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-471d8a7d-93ce-4e57-967a-63458bfe9909 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.106647 Nov 19 19:43:48.892470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1127/2192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:49.404928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:49.405860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:49.413214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:49.413670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:49.414718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:49.414953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:49.451814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04ae32d4-e79e-4aea-a105-b03b8f1f44ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050785 Nov 19 19:43:49.452429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1066/2193] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:49.910378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:49.911345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:49.918668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:49.919115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:49.920032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:49.920464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:49.992738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:50.005799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc0dfa28-2ad6-4141-9d12-ff5db066679a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099164 Nov 19 19:43:50.006808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1128/2194] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:50.464926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:50.465916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:50.474020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:50.474617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:50.475456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:50.475896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:50.511388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-591d7cf6-4e8e-4c65-8b77-1dc7a50e1c40 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050364 Nov 19 19:43:50.517263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1067/2195] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:51.024298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:51.025220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:51.032168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:51.032761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:51.033617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:51.034193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:51.107743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:51.116433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7dce20c-2de6-4424-b422-7b653866ca53 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096334 Nov 19 19:43:51.117036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1129/2196] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:51.525918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:51.526875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:51.535253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:51.535793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:51.536864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:51.537359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:51.595233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-764e8e81-33d8-4a27-a3f2-7d67a98b3b33 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073506 Nov 19 19:43:51.595812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1068/2197] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:52.136164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:52.136930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:52.144428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:52.145525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:52.146742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:52.147273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:52.217221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:52.226168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5f7040a5-0d37-44c0-aad8-9ac69a8ce34d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093822 Nov 19 19:43:52.226760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1130/2198] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:52 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:52.608354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:52.609449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:52.617813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:52.618299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:52.619167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:52.619601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:52.654563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-83437ff3-9cc9-4398-820f-9b085f6e1c56 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050001 Nov 19 19:43:52.655139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1069/2199] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:53.244184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:53.244858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:53.253813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:53.254921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:53.256602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:53.256758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:53.326234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:53.337239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2b5350b3-7b4d-491c-b351-f358a068336f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096765 Nov 19 19:43:53.337860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1131/2200] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:53.667620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:53.668538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:53.675554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:53.676007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:53.677270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:53.677759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:53.716896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c8bc1702-e445-4f33-9ba3-30db3da0e014 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052917 Nov 19 19:43:53.717599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1070/2201] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:54.358297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:54.359413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:54.370218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:54.370860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:54.372199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:54.372958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:54.440667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:54.449276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-338f0817-ba5b-4e6a-80e2-c6a0857c0260 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097617 Nov 19 19:43:54.449874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1132/2202] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:54.730595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:54.731437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:54.739271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:54.740084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:54.740981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:54.741432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:54.781895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9efbf31a-9cdc-4207-a645-67a486b56652 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055577 Nov 19 19:43:54.782548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1071/2203] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:55.467239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:55.468225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:55.476015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:55.476459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:55.477255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:55.477689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:55.555368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:55.563529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2a3aa1fe-9848-423c-bdbd-b9aa2d18dafb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100039 Nov 19 19:43:55.564426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1133/2204] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:43:55.796802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:55.797720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:55.805700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:55.806175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:55.806976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:55.807403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:55.840685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71f2ba08-4c30-4826-9b6e-b314d3cdd50c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047817 Nov 19 19:43:55.841281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1072/2205] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:56.575439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:43:56.575658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:43:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:43:56.584267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:56.585128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:56.596180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:56.596619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:56.597408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:56.597955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:56.665582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:56.674078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2a1c07cc-6337-4c9f-bbbe-96d378b39b05 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095729 Nov 19 19:43:56.674679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1134/2206] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:56.853958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:56.854917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:56.862804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:56.863442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:56.864634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:56.865158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:56.901119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b171cc4d-be4d-4b96-b143-0d79df78bdff tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051125 Nov 19 19:43:56.901733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1073/2207] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:57.692634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:57.693365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:57.700099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:57.700554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:57.701366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:57.701807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:57.773745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:57.782443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4d222b2f-211f-4263-be3c-e3052cd3123f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094073 Nov 19 19:43:57.783027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1135/2208] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:57.913620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:57.914581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:57.921745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:57.922228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:57.923044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:57.923469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:57.956814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-54ebf57c-c42e-46db-9172-c4b985ec83d0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046966 Nov 19 19:43:57.957294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1074/2209] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:43:58.800248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:58.800913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:58.815459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:58.815869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:58.816680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:58.817109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:58.891783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:43:58.901022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-37a3f33c-cfd4-4ace-a49b-8f69b4a8948a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104585 Nov 19 19:43:58.901605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1136/2210] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:43:58.970105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:58.971071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:58.979259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:58.979940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:58.980538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:58.981101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:59.017340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74589739-e9fc-42de-9ecd-f0dc5dde13d5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051688 Nov 19 19:43:59.018114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1075/2211] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:43:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:43:59.921897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:43:59.922598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:43:59.929772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:59.930333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:43:59.931187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:43:59.931630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:00.001380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:00.009969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ea49b46-375c-4b70-a381-3cf70342bff4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093698 Nov 19 19:44:00.010604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1137/2212] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:43:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:00.030949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:00.031886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:00.039210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:00.039659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:00.040485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:00.040868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:00.075572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b8077853-1c34-4067-a347-ba911a69b78c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048351 Nov 19 19:44:00.076169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1076/2213] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:01.027807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:01.028837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:01.037133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:01.037599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:01.038606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:01.039013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:01.089769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:01.092281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:01.100730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:01.101320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:01.102395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:01.102987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:01.116200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:01.128941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2e76a167-9682-479b-9484-95aaf80d8f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.105275 Nov 19 19:44:01.129853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1138/2214] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:01.148055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03fa21b6-8589-4599-a042-afd70a875448 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062271 Nov 19 19:44:01.148522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1077/2215] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:02.152053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:02.154665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:02.159633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:02.160083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:02.160535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:02.161268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:02.161419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:02.162099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:02.170426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:02.171070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:02.172012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:02.172541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:02.224496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-130d319c-6be0-4b46-8ebb-0260d4d7b629 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068289 Nov 19 19:44:02.225501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1078/2216] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:02.230472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:02.239144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5738b982-c4ff-44d7-b03b-181ad08aedde tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090701 Nov 19 19:44:02.239859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1139/2217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:03.239979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:03.240913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:03.248405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:03.248863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:03.249680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:03.250158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:03.259956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:03.260968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:03.269909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:03.269909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:03.271185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:03.271969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:03.295083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a58d3151-1a3d-44c8-a7a3-6a9bf658f955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059037 Nov 19 19:44:03.295805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1079/2218] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:03.357478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:03.370861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6869babc-f2bf-4ffc-8cbc-478d1f7e1ae7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.116945 Nov 19 19:44:03.371476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1140/2219] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:44:04.308283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:04.309233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:04.317065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:04.317671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:04.318568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:04.318987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:04.355876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a614654-8b93-48d0-98de-ec7aac95b697 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051330 Nov 19 19:44:04.356657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1080/2220] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:04.389448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:04.390574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:04.398656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:04.399250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:04.400180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:04.400661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:04.468714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:04.477233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d95afaa-0505-4a30-bdc0-11ef7950f987 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091530 Nov 19 19:44:04.477809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1141/2221] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:05.369334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:05.370312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:05.377717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:05.378217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:05.379037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:05.379476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:05.413932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a62a1b6-088b-47e4-b45a-c513b4c6cf16 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048848 Nov 19 19:44:05.414570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1081/2222] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:05.495503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:05.496198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:05.503508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:05.503984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:05.504882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:05.505322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:05.580074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:05.589254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8682ab1e-a088-42a4-a43b-ff483fc52794 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097742 Nov 19 19:44:05.589849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1142/2223] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:06.426643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:06.427690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:06.435143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:06.435601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:06.436409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:06.436842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:06.484098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bff9b47e-0402-445a-bb13-296c423f9ef5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060926 Nov 19 19:44:06.485141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1082/2224] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:06.615273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:06.615862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:06.622574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:06.623022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:06.623833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:06.624239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:06.691539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:06.700820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-93541e9d-22e9-4889-9215-acfb2ced3995 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089648 Nov 19 19:44:06.701432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1143/2225] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:07.497084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:07.498016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:07.505692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:07.506145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:07.507011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:07.507484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:07.542991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a552565b-d332-4533-b143-1dcaee349d73 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049699 Nov 19 19:44:07.543558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1083/2226] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:07.719289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:07.719955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:07.727166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:07.727609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:07.728402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:07.728923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:07.793970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:07.802789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-430f0a5a-b846-42ef-8a70-c6284d2abaff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087783 Nov 19 19:44:07.803378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1144/2227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:08.556019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:08.556874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:08.564560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:08.565026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:08.565825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:08.566301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:08.601760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e982c865-da05-4e32-855c-df27325e6210 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049968 Nov 19 19:44:08.602477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1084/2228] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:08.820877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:08.821624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:08.829106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:08.829528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:08.830395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:08.830835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:08.919204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:08.928142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-863a487a-c8ca-46d9-a10b-87449ac891ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.111606 Nov 19 19:44:08.928713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1145/2229] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:09.461476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:44:09.461761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:44:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:44:09.613695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:09.615039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:09.622425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:09.622880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:09.623692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:09.624129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:09.659026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7d4e7415-b94d-4f39-8b2f-5767919d65cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049589 Nov 19 19:44:09.659623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1085/2230] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:09.724986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:44:09.725299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:44:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:44:09.946674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:09.947410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:09.954529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:09.954979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:09.955816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:09.956248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:10.044860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:10.056855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f519303a-73d9-42e8-bf52-a53f57b953d6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.113700 Nov 19 19:44:10.057872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1146/2231] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:10.672029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:10.673009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:10.682015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:10.682492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:10.683303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:10.683739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:10.720343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbd6003f-29c4-49b3-a070-04164ed8f0c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052791 Nov 19 19:44:10.720943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1086/2232] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:11.081513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:11.082408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:11.090617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:11.091065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:11.091866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:11.092299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:11.178811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:11.187269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ed5eaa8-3953-4b22-a1d5-cbd244167036 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.109627 Nov 19 19:44:11.187990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1147/2233] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:11.733691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:11.734760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:11.742330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:11.742785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:11.743599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:11.744039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:11.779322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-627bc752-3cf7-4dbf-a914-57e42d1bb784 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050016 Nov 19 19:44:11.779901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1087/2234] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:12.214182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:12.214789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:12.222559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:12.223149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:12.224097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:12.224539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:12.296747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:12.310696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b1f35c5-5eb7-4bb1-9bb8-abb6ae8eb404 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100477 Nov 19 19:44:12.311750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1148/2235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:12.792135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:12.793068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:12.800214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:12.800686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:12.801610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:12.802214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:12.836170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-425e7d4d-31e4-4a4b-acee-047147774980 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048106 Nov 19 19:44:12.836793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1088/2236] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:13.338911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:13.339573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:13.347509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:13.347996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:13.348792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:13.349216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:13.416716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:13.425162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d6cf5c5-8ac6-43a8-97e5-01448d2589d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090997 Nov 19 19:44:13.425791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1149/2237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:13.849167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:13.850277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:13.857783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:13.858310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:13.859113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:13.859545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:13.895571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0bc412ce-7941-4789-b5b3-e410aabaae35 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050766 Nov 19 19:44:13.896255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1089/2238] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:14.442410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:14.443055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:14.450547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:14.451032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:14.452008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:14.452522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:14.529710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:14.538537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ae75f49-8c5d-452b-b8da-f5045a801f74 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099854 Nov 19 19:44:14.539165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1150/2239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:14 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:14.907948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:14.908956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:14.917379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:14.917826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:14.918685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:14.919127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:14.954473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d1857784-52e6-4980-9aab-b23d7a80fd41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050239 Nov 19 19:44:14.955308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1090/2240] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:15.556687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:15.557416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:15.564793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:15.565241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:15.566020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:15.566690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:15.640238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:15.649264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31a8344b-c663-426c-a307-af74085a1613 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096630 Nov 19 19:44:15.649862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1151/2241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:15.967421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:15.968737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:15.977056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:15.977508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:15.978382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:15.978847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:16.015176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cdb958bd-9c62-4932-bd53-fd1f0f30eea5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051703 Nov 19 19:44:16.015762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1091/2242] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:16.667453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:16.668040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:16.675139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:16.675643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:16.676674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:16.677134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:16.744157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:16.753370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aac685a4-a383-4ef9-99b3-c454756c6011 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089736 Nov 19 19:44:16.754262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1152/2243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:17.028380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:17.029344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:17.037011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:17.037444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:17.038392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:17.038843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:17.073392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-49fb8a5e-d8e3-4a5e-b2ee-c01664135b0d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048856 Nov 19 19:44:17.073999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1092/2244] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:17.775404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:17.777649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:17.789419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:17.790236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:17.791623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:17.792322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:17.864559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:17.876190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9eacd93-785a-4c21-9aa5-d89d3f3a47f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107844 Nov 19 19:44:17.876961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1153/2245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:18.085465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:18.086476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:18.094269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:18.094765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:18.095601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:18.096077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:18.132242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-29288053-244f-4eff-9d3b-ebc7f4a1f86a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050804 Nov 19 19:44:18.132936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1093/2246] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:18.905837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:18.906571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:18.914096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:18.914669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:18.915560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:18.916037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:18.992082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:19.000997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52b05698-f1cd-45b3-851a-dedc48672be7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101328 Nov 19 19:44:19.002313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1154/2247] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:19.145359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:19.146471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:19.153857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:19.154263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:19.155108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:19.155568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:19.190641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4bcd640d-f3c3-4fe3-bf6b-13967f429d88 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049466 Nov 19 19:44:19.191349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1094/2248] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:19.971854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:44:19.972523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:44:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:44:20.021714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:20.022473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:20.030515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:20.030959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:20.031763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:20.032193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:20.099805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:20.108149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be81b148-5e45-477c-9c58-c386b774b68d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090786 Nov 19 19:44:20.108787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1155/2249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:20 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:20.203383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:20.204729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:20.213903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:20.214641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:20.215603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:20.216081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:20.250701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d834458d-b30f-4673-9f6a-b416075035b3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051277 Nov 19 19:44:20.251335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1095/2250] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:21.126095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:21.126918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:21.134497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:21.134940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:21.135757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:21.136183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:21.203861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:21.214143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-916fc103-78c9-4631-bb6f-3fa9fadcba19 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092078 Nov 19 19:44:21.214843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1156/2251] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:21.263342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:21.264275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:21.271566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:21.272007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:21.272789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:21.273194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:21.308992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-acff9ae7-a40b-4b61-8af1-912f851bb0d1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049614 Nov 19 19:44:21.309576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1096/2252] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:22.233276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:22.233984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:22.242618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:22.243122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:22.244123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:22.244540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:22.322350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:22.323402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:22.323605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:22.332802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8343dc1-b649-4ee9-9688-707511c53be2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.103778 Nov 19 19:44:22.333494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1157/2253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:22.334098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:22.334971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:22.336342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:22.337092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:22.397480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3cda53d3-6896-416f-ade0-79b111b1f5a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079450 Nov 19 19:44:22.398542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1097/2254] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:23.351804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:23.352426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:23.359269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:23.359712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:23.360528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:23.360955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:23.412481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:23.413401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:23.420655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:23.421195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:23.422405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:23.423032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:23.431781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:23.441819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3b031231-15f7-4b9b-b3ed-5c84a8b04626 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094536 Nov 19 19:44:23.442555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1158/2255] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:23.459137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5f7d61de-3427-493d-bf80-e5460556da09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051373 Nov 19 19:44:23.459786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1098/2256] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:24.460420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:24.461386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:24.471695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:24.472246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:24.473629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:24.474211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:24.475377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:24.476877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:24.484589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:24.485235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:24.486232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:24.486794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:24.526304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-09ee6f17-35db-4c52-a91b-d61b93a198d6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055889 Nov 19 19:44:24.527069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1099/2257] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:24.547633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:24.556654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e166769-33ee-467f-87da-b5724b2ebdea tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100915 Nov 19 19:44:24.557337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1159/2258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:25.539656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:25.540459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:25.547649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:25.548094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:25.548871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:25.549329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:25.577311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:25.578370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:25.584180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c3149d4a-33be-49c6-9311-ada7c5b86330 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048496 Nov 19 19:44:25.584814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1100/2259] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:25.588509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:25.588946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:25.589738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:25.590193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:25.662412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:25.670838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7d62df36-7bd1-46dc-b320-43b8a3196b20 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099174 Nov 19 19:44:25.671437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1160/2260] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:44:26.597425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:26.598903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:26.606474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:26.606991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:26.607822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:26.608294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:26.643261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1dfdca9b-0b68-4e02-86e2-75774cf8f105 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050178 Nov 19 19:44:26.643846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1101/2261] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:26.688829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:26.689454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:26.697334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:26.697793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:26.698631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:26.699106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:26.768406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:26.781800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6eb863e6-8907-4532-b8ee-eb8d2db6633f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096788 Nov 19 19:44:26.782492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1161/2262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:27.657238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:27.658222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:27.665895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:27.666393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:27.667205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:27.667645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:27.702434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b5674599-1c02-49d4-ab4f-4a5dfd1a58f7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050124 Nov 19 19:44:27.703216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1102/2263] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:27.799939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:27.801087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:27.807806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:27.808257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:27.809048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:27.809487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:27.876253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:27.884803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3756118f-5037-4ee7-92b4-0930709ef793 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088550 Nov 19 19:44:27.885389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1162/2264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:28.716303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:28.717231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:28.725254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:28.725700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:28.726545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:28.726976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:28.760814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6647c24e-b9f9-458b-8e0d-4078a7812d6d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048927 Nov 19 19:44:28.761404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1103/2265] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:28.902511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:28.903170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:28.911198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:28.911674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:28.912481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:28.912890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:28.985165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:28.994326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba89c052-976f-40a1-8cb7-bceb40ee3c75 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095376 Nov 19 19:44:28.994916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1163/2266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:29.773792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:29.774736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:29.781871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:29.782411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:29.783249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:29.783721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:29.817816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a51a66b6-6ee2-416d-9ad3-58a5997c3308 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048462 Nov 19 19:44:29.818502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1104/2267] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:30.012184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:30.012852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:30.020699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:30.021119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:30.021906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:30.022350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:30.101624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:30.109941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3891bd8d-7055-417d-af36-936932d7527c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101660 Nov 19 19:44:30.110661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1164/2268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:30.830831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:30.832837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:30.840775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:30.841229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:30.842032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:30.842497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:30.879307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-15215dbf-477f-4c66-94b5-990bae310444 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052705 Nov 19 19:44:30.879910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1105/2269] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:31.127994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:31.128859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:31.135441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:31.136058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:31.136864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:31.137289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:31.201477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:31.209982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01484f21-59b6-4cbf-a285-7f6d8c06bef1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.085723 Nov 19 19:44:31.210915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1165/2270] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:31.891375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:31.892330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:31.899993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:31.900435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:31.901227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:31.901653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:31.937288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1afe12e1-5146-45f8-9e59-4cf43656bac5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049679 Nov 19 19:44:31.937883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1106/2271] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:32.228232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:32.228877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:32.236392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:32.236868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:32.237655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:32.238513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:32.309499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:32.317909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2204ab83-d363-4b91-889c-fbb4682e40d5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093504 Nov 19 19:44:32.318542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1166/2272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:32.949994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:32.951161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:32.958693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:32.959147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:32.959984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:32.960429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:32.997794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-33acb8a1-fefa-4913-b3bc-602556aa6658 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051803 Nov 19 19:44:32.998620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1107/2273] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:33.335982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:33.336893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:33.343918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:33.344411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:33.345179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:33.345621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:33.416691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:33.425147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a16cd420-bfe6-49be-a6ab-0280a5fdf1a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093130 Nov 19 19:44:33.425838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1167/2274] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:34.010553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:34.011529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:34.019018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:34.019440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:34.020278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:34.020712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:34.055248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-167a23e0-922a-4dff-b721-eabb54588c4d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048629 Nov 19 19:44:34.055836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1108/2275] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:34.451381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:34.452098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:34.463475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:34.464220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:34.465554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:34.466222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:34.557459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:34.566425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72bdc960-520d-4703-8a93-c9fa8140960b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.118684 Nov 19 19:44:34.567166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1168/2276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:35.068424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:35.070908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:35.079778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:35.080740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:35.081983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:35.083877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:35.125430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76667646-b2f4-4b50-87d3-eb4a1c5324a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061619 Nov 19 19:44:35.126010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1109/2277] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:35.585920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:35.586605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:35.594389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:35.594842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:35.595645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:35.596080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:35.667259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:35.677739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a42a9e4-c534-44cf-b435-8851967146c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096607 Nov 19 19:44:35.678575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1169/2278] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:36.137490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:36.138458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:36.147433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:36.148233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:36.149640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:36.150457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:36.203984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bcb63a78-a9b6-481d-94d3-8b6ff699c90b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070075 Nov 19 19:44:36.205111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1110/2279] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:36.695979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:36.696664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:36.703550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:36.703998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:36.704786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:36.705215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:36.771101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:36.780464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-91070b89-e73e-4203-b951-2d324b0d48ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088479 Nov 19 19:44:36.781054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1170/2280] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:37.219271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:37.220224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:37.227569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:37.228106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:37.228993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:37.229424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:37.264019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7bf20ad0-712d-4155-ace5-7508ea710607 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049165 Nov 19 19:44:37.264590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1111/2281] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:37.799714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:37.800697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:37.807683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:37.808123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:37.808921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:37.809348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:37.878792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:37.888298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72f21d8b-984b-4fd7-82c2-7e4ec05ce9c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092306 Nov 19 19:44:37.888942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1171/2282] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:38.276268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:38.277406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:38.284457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:38.284909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:38.285711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:38.286181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:38.325131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-22cad61a-8bd2-469c-ad45-e0c6afdbc05d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052905 Nov 19 19:44:38.325741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1112/2283] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:38.906585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:38.907282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:38.914983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:38.915409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:38.916236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:38.916662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:38.990669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:38.999846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7fd7ee3a-1e89-41e5-9b16-2968fc29f4c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097013 Nov 19 19:44:39.000446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1172/2284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:39.339799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:39.341395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:39.353188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:39.353943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:39.355433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:39.356216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:39.390384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-55baa67e-c01c-40f3-875e-6fd55418a79f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056325 Nov 19 19:44:39.391019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1113/2285] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:40.017368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:40.018186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:40.026270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:40.026762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:40.027613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:40.028206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:40.100107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:40.108366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-91efe330-2ee5-4048-81e6-ef456201d514 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095127 Nov 19 19:44:40.108953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1173/2286] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:40.403188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:40.404051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:40.412219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:40.412881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:40.413863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:40.414435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:40.450849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-98280e2d-f836-44e5-8b92-47bffdf6bd8d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051592 Nov 19 19:44:40.451418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1114/2287] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:41.126217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:41.126962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:41.134397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:41.134847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:41.135631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:41.136098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:41.204288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:41.213607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2f8e4eaa-5d7d-4d25-9d20-fd3563d9224e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091138 Nov 19 19:44:41.214237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1174/2288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:41.464444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:41.465296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:41.473501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:41.473956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:41.474800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:41.475245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:41.510867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cb7b2606-4fe8-4c50-8521-118fa05e7b9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050725 Nov 19 19:44:41.511433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1115/2289] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:42.232404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:42.233166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:42.240683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:42.241229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:42.242194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:42.242674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:42.311174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:42.319997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b324589f-e457-4869-b46b-deaece60eb64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091565 Nov 19 19:44:42.320598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1175/2290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:42.524789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:42.525771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:42.533343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:42.533847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:42.535519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:42.536000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:42.570640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d6967a5c-0909-4348-9d64-cb5f9a1cfaa3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049686 Nov 19 19:44:42.571283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1116/2291] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:43.341589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:43.342499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:43.351699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:43.352185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:43.353042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:43.353611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:43.422560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:43.431457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27da0a7b-206a-493a-b46b-ff33599992a4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096545 Nov 19 19:44:43.432046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1176/2292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:43.584123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:43.585097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:43.592213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:43.593009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:43.593834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:43.594308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:43.629462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5666eae9-169d-4556-a10e-993f0764f41a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049288 Nov 19 19:44:43.630174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1117/2293] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:44.449925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:44.450624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:44.458392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:44.458984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:44.459958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:44.460471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:44.528419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:44.537592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-271372b1-f576-4f84-a8d9-b0839f120adb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091255 Nov 19 19:44:44.538197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1177/2294] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:44.642234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:44.643199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:44.651729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:44.652302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:44.653160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:44.653634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:44.690390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b78b9e0f-c0cd-41d6-b95a-97fa0acb392f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052225 Nov 19 19:44:44.691441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1118/2295] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:45.556631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:45.557287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:45.564324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:45.564786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:45.566229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:45.566418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:45.638005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:45.647441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1224675c-885f-4990-b325-8546190949f3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094570 Nov 19 19:44:45.648055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1178/2296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:45.703067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:45.704019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:45.712482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:45.712955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:45.713739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:45.714227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:45.756992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74102018-5f9b-4dbf-8aee-0a9248fdb9b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057450 Nov 19 19:44:45.758007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1119/2297] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:46.666186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:46.666777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:46.674028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:46.674654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:46.675866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:46.676388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:46.743685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:46.752825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ceaf47e2-5e7c-4a15-951a-34d288b5b981 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090408 Nov 19 19:44:46.753857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1179/2298] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:46.772045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:46.773303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:46.781733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:46.782409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:46.783366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:46.783912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:46.818061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e0aca28-a6f9-4581-afa1-f18babb13d2f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050273 Nov 19 19:44:46.818682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1120/2299] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:47.778028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:47.778751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:47.785944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:47.786428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:47.787228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:47.787664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:47.832385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:47.833365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:47.843718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:47.844474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:47.845859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:47.846626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:47.856723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:47.865614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d458411a-af1e-4240-ba84-7b463a6fce8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091289 Nov 19 19:44:47.866438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1180/2300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:47.909497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1c16cae-f4f0-4d99-ac3e-39701cf02a59 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.080766 Nov 19 19:44:47.911065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1121/2301] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:48.886610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:48.887611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:48.898836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:48.899582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:48.900867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:48.901573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:48.925615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:48.926866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:48.933982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:48.934468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:48.935237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:48.935701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:48.983151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3dfbaa9d-e35e-4a25-86e9-ab4ff841f89d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061767 Nov 19 19:44:48.984301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1122/2302] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:48.993674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:49.004374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-10418f99-f331-4da8-9913-f74e186434e8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.124337 Nov 19 19:44:49.005078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1181/2303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:49.996571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:49.997762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:50.006423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:50.006885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:50.007756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:50.008223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:50.024386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:50.025019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:50.034385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:50.035264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:50.036294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:50.036737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:50.057020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c2b2d116-96b4-427d-929d-72b0aa4ac2aa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063339 Nov 19 19:44:50.058108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1123/2304] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:50.133753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:50.143230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83788a48-9975-43a7-82a4-39b51a48cd0e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.122350 Nov 19 19:44:50.144103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1182/2305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:44:51.071321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:51.072689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:51.083948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:51.084930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:51.086824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:51.087574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:51.141800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-279ea32f-dfb3-4b48-ab7b-80f0f9a78bb4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074014 Nov 19 19:44:51.142860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1124/2306] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:51.161243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:51.161860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:51.169050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:51.169375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:51.170195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:51.170625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:51.265614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:51.276036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bd1d4c52-3e22-428e-a89b-e59fd87d75ff tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.118848 Nov 19 19:44:51.277010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1183/2307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:52.156037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:52.156935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:52.164354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:52.164828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:52.165613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:52.166032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:52.200312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-955e23bb-79b7-4ce3-b412-2b9a4fbd5b72 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048163 Nov 19 19:44:52.200902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1125/2308] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:52.294681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:52.295321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:52.302552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:52.302993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:52.303784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:52.304209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:52.397645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:52.407601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9b1af22-faf9-4ee9-9d04-bb162250115d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.116358 Nov 19 19:44:52.408313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1184/2309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:52 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:53.212246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:53.213086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:53.220792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:53.221239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:53.222364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:53.222878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:53.257595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7d4c21cf-51b8-4b18-8b4a-8a47c55bfb8e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049341 Nov 19 19:44:53.258214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1126/2310] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:44:53.433017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:53.433712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:53.440938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:53.440938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:53.442309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:53.442735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:53.519879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:53.531429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e694e0f4-78e9-4cd9-b252-fcccd5c9fd1a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101908 Nov 19 19:44:53.532205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1185/2311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:44:54.270094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:54.271403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:54.279674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:54.280122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:54.280915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:54.281350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:54.315802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8bd55a39-8c3e-4af6-9d90-531a85992bbc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049958 Nov 19 19:44:54.316520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1127/2312] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:54.549596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:54.550330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:54.557479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:54.557931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:54.558779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:54.559221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:54.629420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:54.643610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-77b81dba-e0b6-4286-b3ea-74a7822874be tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097662 Nov 19 19:44:54.644652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1186/2313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:55.328983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:55.330463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:55.340960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:55.341471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:55.343314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:55.343820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:55.380042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84f46041-460d-4cc5-9b1b-607ad208949e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055728 Nov 19 19:44:55.380648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1128/2314] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:55.668619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:55.669251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:55.676556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:55.677008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:55.677804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:55.678271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:55.752543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:55.761899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d80bd467-cd8d-4d8b-a534-b9d16ef3873a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097300 Nov 19 19:44:55.762605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1187/2315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:56.391765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:56.392686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:56.400417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:56.400852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:56.401778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:56.402242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:56.436542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c49303e3-f17c-4734-81d5-c72c9254ad10 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048796 Nov 19 19:44:56.437170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1129/2316] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:56.781658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:56.782794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:56.791467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:56.792177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:56.793074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:56.793605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:56.860504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:56.870795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0987dd48-4b10-402b-8a8b-7db589441105 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093379 Nov 19 19:44:56.871497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1188/2317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:57.449436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:57.450545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:57.458539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:57.458949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:57.459774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:57.460213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:57.497476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59c4964b-dcdb-4eea-8526-78bd79fbd4a9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052031 Nov 19 19:44:57.498295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1130/2318] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:57.891858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:57.892861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:57.903239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:57.903925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:57.905164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:57.905832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:57.983386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:57.993311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8f462a5-b4ca-488a-a3ed-d78c65d3a446 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107783 Nov 19 19:44:57.994360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1189/2319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:58.509774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:58.510754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:58.517915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:58.518546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:58.519748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:58.520235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:58.556058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6e74936c-0d25-40da-b91d-a784e006d7a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050159 Nov 19 19:44:58.556647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1131/2320] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:44:59.011631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:59.012259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:59.021252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:59.021681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:59.022534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:59.022974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:59.092090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:44:59.101026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6935e60-7321-4d8b-b0e2-c70e3f4346f9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093075 Nov 19 19:44:59.101634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1190/2321] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:44:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:44:59.568690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:44:59.569512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:44:59.577067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:59.577511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:59.578355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:44:59.578781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:44:59.614190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4cd7c6b5-0e96-4369-b762-d488e013be02 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049929 Nov 19 19:44:59.614944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1132/2322] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:44:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:00.118306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:00.119047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:00.126792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:00.127240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:00.128029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:00.128466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:00.429509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:00.439314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f51e03c-4baa-40e0-936d-f3617e289b22 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.324594 Nov 19 19:45:00.440164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1191/2323] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:00.628066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:00.629005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:00.636310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:00.636737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:00.637552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:00.637984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:00.671184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cfba1f22-649d-4a70-ab90-cb87d59d0017 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048029 Nov 19 19:45:00.671918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1133/2324] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:01.457235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:01.457852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:01.465082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:01.465525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:01.466339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:01.466793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:01.533959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:01.542583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b8547b6c-93a4-47e0-996a-6831a0e228d4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089240 Nov 19 19:45:01.543185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1192/2325] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:01.684773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:01.685916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:01.693205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:01.693655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:01.694493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:01.694925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:01.731176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e373bc5-55b3-4763-b0fd-c9da1eb90fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050202 Nov 19 19:45:01.731773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1134/2326] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:02.567880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:02.568854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:02.577890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:02.578419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:02.579237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:02.579677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:02.649064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:02.657520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9870597-be1a-43f2-bfe9-2c327cf03590 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094628 Nov 19 19:45:02.658125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1193/2327] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:02.743925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:02.744889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:02.752062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:02.752525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:02.753891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:02.754458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:02.791710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-725a45a3-5659-4eb5-bfe5-1408f4323b2c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051807 Nov 19 19:45:02.792295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1135/2328] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:03.676228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:03.676998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:03.684669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:03.685154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:03.686004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:03.686650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:03.755098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:03.764026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-51e95ce3-e3c7-4df7-8a31-aa21924af2c5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092376 Nov 19 19:45:03.764656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1194/2329] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:03.805021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:03.806466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:03.814225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:03.814803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:03.815916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:03.816456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:03.851384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74b4eb1d-77c4-4291-b3eb-9178795ca4ab tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050602 Nov 19 19:45:03.852366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1136/2330] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:04.781307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:04.783051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:04.790948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:04.791454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:04.792288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:04.792728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:04.862985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:04.865488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:04.867356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:04.872045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c2bb709f-e4b3-47bb-bb04-a19f83e9fc18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094669 Nov 19 19:45:04.872633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1195/2331] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:04.876373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:04.876790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:04.877738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:04.878801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:04.923522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ff7bbbec-b894-48c4-b89a-ac508c0babd7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062222 Nov 19 19:45:04.924991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1137/2332] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:05.898188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:05.898874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:05.906106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:05.906578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:05.907387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:05.907838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:05.940615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:05.943029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:05.953964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:05.954637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:05.955889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:05.956707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:05.991477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:05.993899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48dd6bd5-fc78-43bc-8eb9-521add95e711 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060805 Nov 19 19:45:05.994634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1138/2333] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:06.001537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-26571c15-cc75-4c09-81ee-89dd575fc307 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107257 Nov 19 19:45:06.002885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1196/2334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:07.007718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:07.008638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:07.016090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:07.016540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:07.017338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:07.017790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:07.021029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:07.021841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:07.028694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:07.029133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:07.029935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:07.030408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:07.072087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-28e3d27e-485b-4db7-a87b-e1859c3dca1c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068256 Nov 19 19:45:07.073130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1139/2335] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:07.110482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:07.118968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2139ae64-e9d1-4568-8c5f-217e6be602b0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102497 Nov 19 19:45:07.119576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1197/2336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:08.085764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:08.087038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:08.094971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:08.095563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:08.096456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:08.096938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:08.132506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dec66171-ec1f-4044-b513-9f155ef151f9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050577 Nov 19 19:45:08.133110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1140/2337] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:08.137545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:08.138561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:08.148664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:08.149440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:08.150929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:08.151677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:08.222037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:08.230713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-520a7411-675c-41fd-be44-f0c59b844770 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097955 Nov 19 19:45:08.231307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1198/2338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:09.145147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:09.145967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:09.153165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:09.153607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:09.154435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:09.154863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:09.189902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b729bb43-da94-4a28-86e6-f32439b97bbf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049327 Nov 19 19:45:09.190574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1141/2339] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:09.255096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:09.255740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:09.263152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:09.263769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:09.264779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:09.265310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:09.339494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:09.349075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4bc5ac1-b96a-4b3e-af9c-0b4463f0f82a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098277 Nov 19 19:45:09.349732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1199/2340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:10.202467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:10.203529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:10.211549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:10.212001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:10.212810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:10.213250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:10.248471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c0e84d1-0cff-4a65-a96c-2d4279729c1a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049952 Nov 19 19:45:10.249376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1142/2341] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:10.367296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:10.368009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:10.375086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:10.375540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:10.376354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:10.376972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:10.453391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:10.462206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39800d5c-d016-4afc-8e61-9fce421839b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098765 Nov 19 19:45:10.462766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1200/2342] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:11.261436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:11.262647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:11.270460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:11.270938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:11.271741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:11.272150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:11.308879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48d17728-e271-406b-9b40-a8471ed7066a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051318 Nov 19 19:45:11.309466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1143/2343] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:11.480812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:11.481424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:11.489836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:11.490503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:11.491797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:11.492540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:11.577315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:11.586413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3da8ca2e-be85-4861-a2d6-618445981032 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.109459 Nov 19 19:45:11.587024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1201/2344] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:12.321513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:12.322543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:12.329888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:12.330387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:12.331226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:12.331904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:12.366538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-793ac3bf-0e24-45d7-9b94-919f4334c0f8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048755 Nov 19 19:45:12.367139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1144/2345] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:12.604775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:12.605411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:12.613843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:12.614457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:12.615307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:12.615779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:12.699205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:12.711073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0128293-911e-4eea-9dd0-b04fca4e94b6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.110074 Nov 19 19:45:12.711783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1202/2346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:13.379298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:13.380307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:13.387450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:13.387945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:13.388956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:13.389446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:13.423413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd0a404f-a588-4bb3-8cf5-6f9a931fdd82 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048209 Nov 19 19:45:13.424029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1145/2347] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:13.729152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:13.730085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:13.737673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:13.738230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:13.739232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:13.739704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:13.809386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:13.819303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a187b9d3-8c38-4452-9601-dad56ec8f9eb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093896 Nov 19 19:45:13.819899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1203/2348] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:14.436377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:14.437316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:14.445567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:14.445998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:14.446854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:14.447266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:14.485533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-011f8726-f057-4c51-b86f-58b006f9816e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053396 Nov 19 19:45:14.486143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1146/2349] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:14.837462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:14.838267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:14.847128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:14.847661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:14.848605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:14.849096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:14.915947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:14.928853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-222fa657-a7cf-40a5-9717-9ada583ab4fd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095160 Nov 19 19:45:14.929513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1204/2350] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:14 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:15.498367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:15.499694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:15.508004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:15.508549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:15.509470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:15.510012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:15.545462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ff14dca-99b4-4a25-ba4a-5e1cf62e4dec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051223 Nov 19 19:45:15.546087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1147/2351] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:15.948978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:15.949988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:15.961759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:15.962558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:15.963935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:15.964680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:16.036440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:16.045154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-abe4717c-b616-4c6b-a0e3-e93b6ccf46cf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099972 Nov 19 19:45:16.045728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1205/2352] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:16.560442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:16.561323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:16.569363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:16.569814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:16.570659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:16.571089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:16.606420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2384aafd-b154-4df7-8c9e-5b54606a33dc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049964 Nov 19 19:45:16.607158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1148/2353] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:17.063812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:17.064516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:17.072308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:17.072756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:17.073568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:17.074005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:17.147762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:17.156877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a4413016-fed2-407c-a1d7-700944f35f6e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096672 Nov 19 19:45:17.157659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1206/2354] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:17.619512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:17.620338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:17.628723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:17.629167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:17.630024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:17.630508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:17.666558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e2d67c34-d94a-4eab-8405-2937240f6deb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051050 Nov 19 19:45:17.667314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1149/2355] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:18.177455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:18.178154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:18.185317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:18.185768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:18.186615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:18.187055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:18.258896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:18.271920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be9b12af-0e21-4e06-92b4-c7b51eb41f45 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098943 Nov 19 19:45:18.272962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1207/2356] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:18.679719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:18.680634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:18.687624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:18.688050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:18.688871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:18.689290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:18.724576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3d73d23d-84e7-4fb3-abec-19185fb5d2f5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048661 Nov 19 19:45:18.725245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1150/2357] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:19.297102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:19.297809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:19.305596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:19.306077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:19.306883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:19.307340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:19.380063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:19.388000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-66cef16f-af35-4849-a30b-da696acf2603 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094790 Nov 19 19:45:19.388573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1208/2358] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:19.736208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:19.737840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:19.745167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:19.745606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:19.746475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:19.747002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:19.783059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9170bfe0-7760-4091-b15b-fdd4204469ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050745 Nov 19 19:45:19.783761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1151/2359] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:20.405658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:20.406346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:20.414402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:20.414824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:20.415639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:20.416071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:20.496202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:20.505741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3f4ed8d-3d1d-4528-b35f-f615346377ee tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.103786 Nov 19 19:45:20.506254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1209/2360] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:20 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:20.798187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:20.798985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:20.808678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:20.809125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:20.810081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:20.810629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:20.846864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5fdb4aee-5caf-4af4-b264-32c2166cab28 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054793 Nov 19 19:45:20.847207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1152/2361] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:21.527357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:21.529376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:21.539335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:21.539954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:21.540819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:21.541287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:21.610214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:21.619597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f39bd5a-8f2e-4a90-a5d8-aad0d5252996 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099171 Nov 19 19:45:21.620368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1210/2362] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:21.859376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:21.860182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:21.867789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:21.868240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:21.869036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:21.869470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:21.904587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-da6b09f8-1224-4dad-9f97-c8af437d789b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049291 Nov 19 19:45:21.905150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1153/2363] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:22.641285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:22.642389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:22.654199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:22.654979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:22.656372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:22.657131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:22.727362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:22.735818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-87d05107-e02c-467d-950e-2e46deb372e4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101470 Nov 19 19:45:22.736474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1211/2364] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:22.917424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:22.918314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:22.925520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:22.925955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:22.926804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:22.927216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:22.966851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14ae866f-779e-4e47-ac27-821731a6bf50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053440 Nov 19 19:45:22.967525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1154/2365] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:23.754072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:23.754823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:23.762396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:23.762893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:23.763822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:23.764324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:23.838271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:23.846880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd43e29f-53f8-4f1b-ba8b-c6b72c147c02 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096613 Nov 19 19:45:23.847471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1212/2366] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:23.980759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:23.981680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:23.989376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:23.989845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:23.990684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:23.991094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:24.027828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0738529a-9dbb-433f-9abd-ce27bdce7e60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051649 Nov 19 19:45:24.028332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1155/2367] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:24.865311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:24.866007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:24.873305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:24.873781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:24.874643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:24.875077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:24.952842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:24.961392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a558dd84-4f29-4610-9ef1-b69c1f27066c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100566 Nov 19 19:45:24.961956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1213/2368] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:25.040573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:25.041734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:25.049158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:25.049607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:25.050444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:25.050873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:25.084942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b4ed721-7051-42de-8d53-74d81530f4c8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048218 Nov 19 19:45:25.085755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1156/2369] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:25.979551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:25.980347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:25.988356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:25.988825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:25.989632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:25.990072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:26.056966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:26.066224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27842896-ed4d-4d6f-8b4f-e6091ac8be00 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090236 Nov 19 19:45:26.067099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1214/2370] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:26.099617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:26.100555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:26.107925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:26.108379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:26.109186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:26.109623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:26.144773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc58e658-8100-46fe-92ed-cd12b7e5622b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049243 Nov 19 19:45:26.145367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1157/2371] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:27.085326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:27.085989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:27.093105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:27.093551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:27.094366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:27.094794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:27.160204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:27.161347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:27.161531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:27.170626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e00d3766-c62b-42cb-87b9-1d8bdacd0298 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088928 Nov 19 19:45:27.171281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1215/2372] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:27.172033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:27.172168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:27.173194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:27.173744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:27.207524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-790b720f-e06b-4708-b69a-b0cd77329372 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053299 Nov 19 19:45:27.208057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1158/2373] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:28.196803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:28.197488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:28.204434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:28.204880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:28.206006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:28.206650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:28.228105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:28.229233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:28.236852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:28.237479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:28.238452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:28.239002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:28.277108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1eff435-4b24-41b0-874d-fbdde285d1ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055764 Nov 19 19:45:28.278711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1159/2374] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:28.280696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:28.289598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ada6c2fe-6786-46e9-861a-09fb77775595 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096626 Nov 19 19:45:28.290204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1216/2375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:29.288784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:29.289759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:29.297090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:29.297582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:29.298669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:29.299361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:29.308568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:29.309449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:29.317686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:29.318406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:29.319434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:29.320016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:29.339445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ea6e5cc-b8c1-46cd-bdd2-635f1623a36a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054372 Nov 19 19:45:29.340203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1160/2376] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:29.389726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:29.398608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8304a853-5a6a-49be-8b83-33e607ca505c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094342 Nov 19 19:45:29.399340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1217/2377] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:30.353604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:30.354597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:30.362079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:30.362575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:30.363407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:30.363910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:30.404566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b22c2e9c-79fd-44a1-b671-090b83388535 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054846 Nov 19 19:45:30.405132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1161/2378] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:30.416511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:30.417176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:30.424859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:30.425257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:30.426074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:30.426510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:30.493148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:30.501594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-490cb068-1ae9-44dc-965f-12d2a3c211a2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088852 Nov 19 19:45:30.502449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1218/2379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:31.417521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:31.418467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:31.425835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:31.426321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:31.427207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:31.427633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:31.463506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c3bc04f9-c6c3-46b4-8ec8-bc12d88b8044 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050420 Nov 19 19:45:31.464377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1162/2380] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:31.522671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:31.523343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:31.532861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:31.533452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:31.534334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:31.534794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:31.611717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:31.620638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e87ab94f-f42b-4eca-8ccf-a1d19407da06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102658 Nov 19 19:45:31.621315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1219/2381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:32.476511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:32.477434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:32.484463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:32.484904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:32.485683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:32.486149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:32.519559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-620879dd-b632-4a7e-a35f-db047a0a3422 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047162 Nov 19 19:45:32.520208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1163/2382] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:45:32.638916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:32.639623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:32.647220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:32.647662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:32.648453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:32.648868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:32.725334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:32.739288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5d3e031-8b44-496c-8152-632197803251 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.103988 Nov 19 19:45:32.740304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1220/2383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:33.052756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:45:33.053085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:45:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:45:33.532394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:33.533219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:33.540725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:33.541269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:33.542216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:33.542676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:33.580738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-493f14b8-65d8-422c-af32-ef585d1f92d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052858 Nov 19 19:45:33.581410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1164/2384] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:33.757796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:33.758560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:33.766565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:33.767024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:33.768082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:33.768609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:33.849205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:33.857757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8d80640-2976-4a5f-8f7e-21e4f8554d89 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104108 Nov 19 19:45:33.858375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1221/2385] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:34.593893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:34.595945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:34.603854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:34.604300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:34.605079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:34.605507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:34.649000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-41ab3f95-04ff-4766-bd35-84e1d728c854 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059441 Nov 19 19:45:34.649685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1165/2386] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:34.884814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:34.885417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:34.892691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:34.893121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:34.893949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:34.894505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:34.969374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:34.983300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6683335-6728-46d0-81e3-99d17b2250fc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102492 Nov 19 19:45:34.984535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1222/2387] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:35.662788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:35.664014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:35.672832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:35.673419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:35.674438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:35.674981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:35.711725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df85194a-4a96-4a6e-ae4b-bfd821025d2b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053833 Nov 19 19:45:35.712506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1166/2388] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:36.011029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:36.011673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:36.019550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:36.020014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:36.020812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:36.021248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:36.095977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:36.109112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79e743dd-fbeb-4980-a465-38b50ccf708a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101685 Nov 19 19:45:36.110123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1223/2389] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:36.727402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:36.728507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:36.737271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:36.737716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:36.738932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:36.739615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:36.774733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11c5da40-c092-4ffd-8c91-a7f12e5d1f3a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053390 Nov 19 19:45:36.775343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1167/2390] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:37.128106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:37.128986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:37.136258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:37.136676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:37.137483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:37.137916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:37.208935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:37.217480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c944ed9e-71a4-4d1d-b8c2-882f01455456 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093656 Nov 19 19:45:37.218485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1224/2391] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:37.789826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:37.790789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:37.797929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:37.798424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:37.799393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:37.800108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:37.835383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bff559dc-7a8d-4a5f-aea2-ec95fe523f00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049477 Nov 19 19:45:37.835987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1168/2392] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:38.236010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:38.237884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:38.244081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:38.244530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:38.245333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:38.246103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:38.320712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:38.329473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-532555c3-6f8b-4968-9aed-8813a8560683 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097180 Nov 19 19:45:38.330477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1225/2393] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:38.850356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:38.851290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:38.858425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:38.858923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:38.859689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:38.860133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:38.894825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6dd00d06-e476-47dd-85c8-36653c296458 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048386 Nov 19 19:45:38.895446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1169/2394] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:39.348975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:39.349651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:39.358316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:39.358909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:39.360231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:39.360969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:39.430775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:39.439780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-575f6d55-5aa1-42e5-ba78-e747ca3bc5de tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094857 Nov 19 19:45:39.440386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1226/2395] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:39.907451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:39.908585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:39.915933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:39.916378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:39.917232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:39.917664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:39.952185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7924dcb7-adf0-465d-9e90-20d55edbf570 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048745 Nov 19 19:45:39.952728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1170/2396] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:40.466232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:40.466876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:40.475359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:40.475847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:40.476783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:40.477262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:40.544421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:40.553278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cf5e3857-4056-4cd6-b052-a1d46ffe36d7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091122 Nov 19 19:45:40.553849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1227/2397] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:40.968249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:40.969204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:40.977062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:40.977516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:40.978362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:40.978808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:41.015168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11ad85cd-45b2-454d-a479-4afa19bd182a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053697 Nov 19 19:45:41.016041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1171/2398] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:41.575058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:41.576021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:41.587596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:41.588384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:41.589767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:41.590580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:41.674754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:41.683785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-96f3ada9-54c3-48fc-966e-19d19abf5926 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.115627 Nov 19 19:45:41.684369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1228/2399] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:42.029156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:42.030623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:42.038304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:42.038750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:42.039548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:42.039982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:42.073879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-437c45ec-bbf8-4ddd-8d48-726acf6c46e3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049035 Nov 19 19:45:42.074616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1172/2400] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:42.701923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:42.702839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:42.710251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:42.710782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:42.711640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:42.712183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:42.944523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:42.954114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4375f8f4-647c-4e2e-bcb8-c15398b67cbf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.255853 Nov 19 19:45:42.954710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1229/2401] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:43.086565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:43.087806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:43.095725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:43.096237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:43.097421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:43.097900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:43.132108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5c83f9fb-8d6f-444f-97fb-2c4d881b926d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049733 Nov 19 19:45:43.133012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1173/2402] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:43.972629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:43.973190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:43.980369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:43.980813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:43.981607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:43.982073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:44.045209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:44.054152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-906cbce6-98b1-4b1c-b9c0-fa22019bf413 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.085389 Nov 19 19:45:44.054711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1230/2403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:44.144654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:44.145558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:44.152465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:44.152965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:44.153827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:44.154437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:44.188461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7fc467f-45e1-403d-be90-b7f8f53cb52b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047668 Nov 19 19:45:44.189048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1174/2404] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:44 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:45.075070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:45.075845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:45.087055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:45.087810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:45.089112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:45.089848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:45.186960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:45.195294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d7a6bb94-b3cf-4f34-8f27-dc1b51e13bbb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.126952 Nov 19 19:45:45.195876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1231/2405] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:45.203171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:45.204081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:45.215857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:45.216299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:45.217083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:45.217861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:45.253921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f587cc6b-8874-4153-bf99-8c11acc73391 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052311 Nov 19 19:45:45.254940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1175/2406] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:46.212700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:46.213524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:46.220958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:46.221617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:46.222509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:46.222965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:46.267024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:46.268638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:46.276452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:46.276918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:46.277710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:46.278184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:46.309518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:46.314452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60c9a424-d72d-4010-aea1-d7599578e01e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050997 Nov 19 19:45:46.315957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1176/2407] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:46.323826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d3c3469c-ee09-4a48-b6c6-05b652f276c4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.114489 Nov 19 19:45:46.324870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1232/2408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:47.326686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:47.327630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:47.335416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:47.335869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:47.336663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:47.337136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:47.350292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:47.351176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:47.358736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:47.359211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:47.360006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:47.360443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:47.374907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d1b15f52-67f6-4fc3-9e70-0183f1f7b82a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051926 Nov 19 19:45:47.375738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1177/2409] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:47.438274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:47.447532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-25cb51aa-4135-4917-b197-fdcd9fe2dd47 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100956 Nov 19 19:45:47.448169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1233/2410] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:48.388246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:48.389231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:48.396572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:48.397083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:48.397944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:48.398650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:48.432768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4bd4c937-1e75-400f-8be3-8f721f436f9f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048685 Nov 19 19:45:48.433434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1178/2411] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:48.470085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:48.471626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:48.483302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:48.484110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:48.485505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:48.486275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:48.553473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:48.562135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52012d27-c87b-4cac-9a8e-9f0bd12606c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099698 Nov 19 19:45:48.562798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1234/2412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:49.445537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:49.446552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:49.453692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:49.454314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:49.455431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:49.456034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:49.491002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6970a54a-6ee0-464e-bb27-6de1acad6ca3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049263 Nov 19 19:45:49.491594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1179/2413] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:49.579952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:49.580665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:49.587906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:49.588364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:49.589169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:49.589606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:49.657875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:49.666467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-16cce665-6021-49c1-9a90-cf18b740026a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090337 Nov 19 19:45:49.667073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1235/2414] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:50.503408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:50.504408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:50.512720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:50.513417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:50.514720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:50.515465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:50.574251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8218a284-1b1d-401d-8be8-67cae16143d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.074442 Nov 19 19:45:50.575285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1180/2415] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:50.684791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:50.685483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:50.693228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:50.693672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:50.694511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:50.694939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:50.761179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:50.770517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dba3634c-c3e9-44f9-90b9-c00c4c76f5c3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089473 Nov 19 19:45:50.771191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1236/2416] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:51.587420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:51.588334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:51.596349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:51.596879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:51.597713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:51.598225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:51.632347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b583f6c6-fc1e-49d6-a32f-121d9127149c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048861 Nov 19 19:45:51.632949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1181/2417] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:51.788922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:51.789954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:51.798226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:51.798809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:51.800013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:51.800456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:51.906908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:51.920457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d5a3af3-6c53-4378-9446-6396c96e783a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.135771 Nov 19 19:45:51.921430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1237/2418] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:51 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:52.644895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:52.645867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:52.653570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:52.654099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:52.654977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:52.655443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:52.691972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fbb7a1b5-30ec-482f-80ff-ec3ed1746621 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050959 Nov 19 19:45:52.692818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1182/2419] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:52.941807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:52.943166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:52.955591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:52.956468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:52.959233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:52.959430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:53.056516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:53.065644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8572ce71-0c72-4f01-8368-5001e2bf4998 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.128338 Nov 19 19:45:53.066283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1238/2420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:52 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:53.704962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:53.705813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:53.713260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:53.713708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:53.714547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:53.714969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:53.751727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-724d8156-e246-43c5-bf98-1de2e8de51ed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050841 Nov 19 19:45:53.752431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1183/2421] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:54.084741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:54.085755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:54.094077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:54.094568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:54.095655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:54.096216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:54.163812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:54.172057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fae64535-e376-4796-b542-3d178dfd6a28 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092177 Nov 19 19:45:54.172659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1239/2422] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:54.765947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:54.767103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:54.774950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:54.775534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:54.776545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:54.777079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:54.812489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3415b69d-dace-4184-861d-b5bfb9434ef3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050952 Nov 19 19:45:54.813129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1184/2423] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:55.189278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:55.189880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:55.197363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:55.197872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:55.199105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:55.199851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:55.271432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:55.279714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8da4fa8d-3025-4d0d-b451-a434a711ed3f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094390 Nov 19 19:45:55.280371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1240/2424] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:45:55.825173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:55.826531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:55.834528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:55.835043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:55.836228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:55.836775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:55.872529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ceefc9cf-8650-40b0-8033-947459af6509 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051457 Nov 19 19:45:55.873151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1185/2425] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:56.298438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:56.299370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:56.307396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:56.307902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:56.308728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:56.309228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:56.380105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:56.388385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bc5f56b5-cc7b-4dfe-b632-d7dde311cab3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094062 Nov 19 19:45:56.389091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1241/2426] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:56.885038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:56.886080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:56.893935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:56.894473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:56.895335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:56.895807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:56.930602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-281a33d2-4ffe-4d74-b564-f0bc5243bc00 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049458 Nov 19 19:45:56.931294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1186/2427] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:57.407073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:57.407914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:57.415378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:57.415918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:57.416774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:57.417263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:57.481792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:57.490191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f29eb933-7dde-426c-a9c1-5863fb53c856 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.086949 Nov 19 19:45:57.490793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1242/2428] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:57.946663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:57.948262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:57.959590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:57.960373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:57.961773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:57.962557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:58.019145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20427d97-97c7-44a8-a1ef-06c28e49b9c6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079959 Nov 19 19:45:58.019764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1187/2429] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:58.507826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:58.508445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:58.515517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:58.515965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:58.516768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:58.517208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:58.591699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:58.602299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c5adf47b-af2f-4265-8be8-5ae9ff8febce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098220 Nov 19 19:45:58.602909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1243/2430] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:45:59.033809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:59.034816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:59.042111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:59.042568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:59.043353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:59.043797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:59.083672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-af90f738-992a-4ec9-b834-cf5829d208ba tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053932 Nov 19 19:45:59.084278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1188/2431] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:45:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:45:59.620621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:45:59.621262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:45:59.628758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:59.629210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:59.630016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:45:59.630566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:45:59.699584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:45:59.708316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ea5275c-c910-4be3-9519-f550e8d307b2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091611 Nov 19 19:45:59.708885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1244/2432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:45:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:00.096316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:00.097269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:00.104596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:00.105046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:00.105842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:00.106311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:00.140415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-99220590-4dc6-4ce4-aa71-74116d0e231b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048531 Nov 19 19:46:00.140999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1189/2433] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:00.726917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:00.727593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:00.734694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:00.735157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:00.735953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:00.736383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:00.802738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:00.811261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6e1478ec-fbcd-40e4-813b-1320df584cd9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088065 Nov 19 19:46:00.811833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1245/2434] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:00 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:01.152665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:01.153600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:01.161802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:01.162311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:01.163220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:01.163658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:01.197985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-83081bd2-8266-43b8-94d8-95a370d84054 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049268 Nov 19 19:46:01.198688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1190/2435] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:01 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:01.829137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:01.829984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:01.837610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:01.838086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:01.838969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:01.839398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:01.907131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:01.915984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61c2b454-6b15-45d0-a64c-94870db79de1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090598 Nov 19 19:46:01.916606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1246/2436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:02.215210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:02.216498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:02.224064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:02.224636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:02.225552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:02.226128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:02.260200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de2f2eb7-3b48-4b55-9619-063c5bc668c3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051686 Nov 19 19:46:02.260795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1191/2437] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:02.932956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:02.933675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:02.941981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:02.942535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:02.943381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:02.943858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:03.012380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:03.021812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e836078b-9546-42ec-a8f7-ef0fd7c8544a tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092523 Nov 19 19:46:03.022496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1247/2438] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:03.273072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:03.273995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:03.281357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:03.281807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:03.282867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:03.283552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:03.318459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ca42246-65b4-4689-a600-c58a841402b8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049294 Nov 19 19:46:03.319070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1192/2439] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:04.040761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:04.041463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:04.050036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:04.050528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:04.051402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:04.051878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:04.126752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:04.136315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b2e1dadf-18ac-4d14-84dd-f697f8cc47e5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.099356 Nov 19 19:46:04.137133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1248/2440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:04.331562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:04.332525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:04.339926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:04.340356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:04.341151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:04.341580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:04.360282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Nov 19 19:46:04.360658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:46:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:46:04.385659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b6f372ca-165c-4a54-9dd7-8fa22d592c86 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058590 Nov 19 19:46:04.386384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1193/2441] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:05.156587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:05.157368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:05.165273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:05.170338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:05.170338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:05.170338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:05.255882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:05.265531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f1ed30b6-65e2-4f40-9198-f088b9dcfb87 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.113993 Nov 19 19:46:05.266139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1249/2442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:05.398690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:05.399687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:05.407015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:05.407652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:05.408915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:05.409615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:05.446293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e4e7881-1e53-4430-87c9-0756c0efd897 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052110 Nov 19 19:46:05.446886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1194/2443] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:06.285080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:06.285745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:06.293064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:06.293619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:06.294336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:06.294805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:06.360095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:06.369063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-110878d8-9ba7-4f3c-b675-714b9b2fd59c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088384 Nov 19 19:46:06.369647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1250/2444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:06.461000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:06.461922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:06.470250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:06.470776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:06.471725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:06.472292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:06.507692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aeed76ac-4979-450a-a01b-2d5bcabca915 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050380 Nov 19 19:46:06.508636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1195/2445] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:07.393765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:07.394504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:07.401542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:07.401992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:07.402813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:07.403244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:07.469390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:07.478011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6595ad6-ba5c-4e7f-9abf-89a963c21045 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.088433 Nov 19 19:46:07.478632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1251/2446] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:07.520581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:07.521580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:07.528666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:07.529167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:07.530081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:07.530573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:07.565491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e8cd159-f21d-4ff3-993b-b9274b32b58b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049660 Nov 19 19:46:07.566125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1196/2447] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:46:08.504459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:08.505133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:08.512298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:08.512745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:08.513536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:08.513972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:08.661576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:08.671483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dffcb08e-cf63-490f-907a-53a1f6d818fa tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.170548 Nov 19 19:46:08.672307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1252/2448] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:08.767776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:08.768800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:08.776748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:08.777246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:08.778155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:08.778632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:08.814888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b4fd3073-732b-4244-ba00-a161f60f8a93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.240682 Nov 19 19:46:08.815499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1197/2449] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:46:09.689990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:09.690686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:09.698357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:09.698802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:09.699597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:09.700044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:09.766920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:09.775907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2989edad-e2ed-4f78-9405-8c450ee1c7a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090239 Nov 19 19:46:09.776598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1253/2450] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:09.827248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:09.828170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:09.836506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:09.837032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:09.837873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:09.838393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:09.874975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1c907ef-ced2-4bb6-941f-e49955af6284 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051483 Nov 19 19:46:09.875719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1198/2451] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:10.794644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:10.795322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:10.802853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:10.803297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:10.804084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:10.804499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:10.871434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:10.880056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-035d2656-58fa-4c34-a942-d43b842879ce tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089421 Nov 19 19:46:10.880613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1254/2452] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:10 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:10.888149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:10.889105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:10.896807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:10.897260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:10.898082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:10.898597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:10.933656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e523cf4-8569-4266-9773-00142e8abb0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049530 Nov 19 19:46:10.934267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1199/2453] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:11.900926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:11.902074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:11.914232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:11.914935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:11.916180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:11.916934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:11.945089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:11.946020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:11.953012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:11.953456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:11.954334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:11.954768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:12.000051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a66c5434-880d-4411-be47-d2e46916489d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058713 Nov 19 19:46:12.001518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1200/2454] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:12.009759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:12.019091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a2df7d7d-3b08-48b6-95cf-7a2c5c4c7a55 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.125117 Nov 19 19:46:12.019668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1255/2455] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:13.014904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:13.015848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:13.026359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:13.026811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:13.027613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:13.028050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:13.036891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:13.037632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:13.049673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:13.050504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:13.051868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:13.052670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:13.061912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-898ed138-5dd0-429e-a22f-bd8ef1e956a7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052596 Nov 19 19:46:13.062551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1201/2456] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:46:13.139211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:13.151315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-170b705f-a2dd-436a-bb9e-3a00f9258b6b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.117840 Nov 19 19:46:13.152232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1256/2457] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:46:14.073403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:14.074446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:14.082111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:14.082730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:14.083586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:14.084085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:14.120427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60c07464-c385-426e-be02-4610a957f8e2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050997 Nov 19 19:46:14.121002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1202/2458] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:14.170982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:14.171713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:14.179743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:14.180190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:14.180989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:14.181427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:14.276854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:14.285449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae8552d7-b875-4292-909a-065a403ede65 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.118109 Nov 19 19:46:14.286017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1257/2459] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:14 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:15.134869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:15.135817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:15.143206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:15.143675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:15.144456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:15.144896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:15.180080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd783fec-1b1d-459a-987d-25710481aed4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049225 Nov 19 19:46:15.180678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1203/2460] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:15.310105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:15.310900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:15.318294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:15.318747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:15.319546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:15.319984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:15.397160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:15.405395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9a0c395b-4817-4837-86b1-25cc5e286de5 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098920 Nov 19 19:46:15.405991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1258/2461] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:16.195274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:16.196560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:16.204518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:16.204969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:16.205750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:16.206262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:16.240888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c1c5d34-b83f-40a6-80da-ffdf11a82d03 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050158 Nov 19 19:46:16.241508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1204/2462] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:16.423317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:16.424089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:16.431489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:16.431974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:16.432818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:16.433256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:16.500630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:16.509762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fccabaf4-f405-4939-a405-a392a01a6155 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090515 Nov 19 19:46:16.510367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1259/2463] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:17.256502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:17.257363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:17.265033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:17.265464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:17.266336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:17.266997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:17.301954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd25556c-14cb-4eab-a78e-0196147bfc0a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051793 Nov 19 19:46:17.302596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1205/2464] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:17.527360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:17.528012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:17.535444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:17.535897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:17.536691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:17.537126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:17.612584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:17.622096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-48d27cd4-271f-45c4-927d-59a8ffa1173c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098809 Nov 19 19:46:17.622712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1260/2465] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:18.315672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:18.317012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:18.326485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:18.326889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:18.327834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:18.328343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:18.363716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4bf4aaa5-fe1a-4721-ab64-9db3dde7775c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052816 Nov 19 19:46:18.364303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1206/2466] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:18 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:18.639625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:18.640208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:18.647916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:18.648367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:18.649173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:18.649586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:18.722754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:18.731029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a1a27233-e2cd-4e16-b850-2c94f5cec6ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095411 Nov 19 19:46:18.731617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1261/2467] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:19.376391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:19.377419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:19.384739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:19.385191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:19.385978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:19.386450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:19.430954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-caba1b16-0ac2-42f1-8951-4a3f41b68d20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058401 Nov 19 19:46:19.431958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1207/2468] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:19.749085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:19.749710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:19.757496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:19.757942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:19.758957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:19.759472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:19.828754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:19.837456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-26e70a4a-6689-4ef5-ab3a-86abef05ee06 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092191 Nov 19 19:46:19.838173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1262/2469] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:20.448170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:20.449137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:20.456521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:20.456976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:20.457786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:20.458262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:20.493738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-668bb6e8-e5f1-46d9-a452-c016a0dbd403 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051109 Nov 19 19:46:20.494447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1208/2470] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:20.855907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:20.856651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:20.863811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:20.864268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:20.865060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:20.865486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:20.943848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:20.954017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-003dbd52-21e5-45c1-bd2b-9f8c73fc0b18 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.101725 Nov 19 19:46:20.954959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1263/2471] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:20 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:21.507343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:21.508409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:21.515982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:21.516573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:21.517604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:21.518161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:21.552596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e38efdd3-ef59-4e5a-9438-957f657a1031 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051004 Nov 19 19:46:21.553198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1209/2472] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:21.974289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:21.974939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:21.982742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:21.983189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:21.984023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:21.984446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:22.052668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:22.061363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4a1fef97-7e4b-4064-af60-70217073c29c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091432 Nov 19 19:46:22.061962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1264/2473] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:22.565172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:22.566139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:22.573428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:22.573933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:22.574835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:22.575422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:22.611116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fb3bebf9-9c8d-4911-9c97-4eda76661cfd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050106 Nov 19 19:46:22.611682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1210/2474] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:23.079672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:23.080367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:23.088687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:23.089132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:23.089942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:23.090450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:23.158306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:23.167213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f1154ee9-48e1-4dc1-a350-fda76f3f8df3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091623 Nov 19 19:46:23.167816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1265/2475] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:23.623733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:23.624543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:23.632043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:23.632573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:23.633507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:23.634039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:23.670842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa222135-61e4-4f14-9f63-b87bf9272304 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051092 Nov 19 19:46:23.671632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1211/2476] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:24.185043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:24.185816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:24.192699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:24.193145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:24.193919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:24.194400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:24.261795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:24.270877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-404adc32-26a9-432d-a56d-16ca40b98ecb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089597 Nov 19 19:46:24.271490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1266/2477] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:24.683472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:24.684410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:24.692149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:24.692595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:24.693430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:24.693878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:24.729399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-855c3641-4812-4aae-8162-d5e173fa4e41 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049734 Nov 19 19:46:24.730000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1212/2478] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:25.296227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:25.297112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:25.304510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:25.305024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:25.305896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:25.306362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:25.389684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:25.404174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-780a14c2-b962-41eb-8698-2b88cb33b0a0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.111539 Nov 19 19:46:25.405212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1267/2479] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:25.742152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:25.743033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:25.750177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:25.750671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:25.751767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:25.752200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:25.785974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d987c162-2b2a-40fc-ae4d-b13b067fda0f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047713 Nov 19 19:46:25.786599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1213/2480] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:26.429414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:26.430187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:26.438355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:26.438836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:26.439734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:26.440327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:26.511493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:26.526251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-41cabc76-ec5e-4303-9817-bdba9c4f7e4e tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.100321 Nov 19 19:46:26.527303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1268/2481] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:26.801106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:26.801921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:26.809044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:26.809527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:26.810410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:26.810876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:26.845564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a1c05db-9165-42b4-8355-b0d5aba4902a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048799 Nov 19 19:46:26.846342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1214/2482] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:27.552629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:27.553587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:27.560628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:27.561139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:27.561947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:27.562424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:27.628139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:27.636232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c931271e-a337-44cf-aea9-f737d323c27f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087953 Nov 19 19:46:27.636813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1269/2483] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:27.857576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:27.858578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:27.866388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:27.866835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:27.867620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:27.868045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:27.901896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-841c0fb2-2035-4992-835c-ec20d91b99fe tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048244 Nov 19 19:46:27.902523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1215/2484] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:28.654245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:28.655061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:28.663642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:28.664089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:28.664880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:28.665306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:28.745917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:28.754634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43384d1d-8f1d-4a91-ba22-3bcb4cd6d12c tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104447 Nov 19 19:46:28.755228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1270/2485] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:28.914141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:28.914987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:28.922960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:28.923620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:28.924551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:28.925033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:28.960806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d824e6fe-dc08-4fa8-8e1c-c416d9e75362 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050942 Nov 19 19:46:28.961543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1216/2486] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:29.771892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:29.772647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:29.780041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:29.780498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:29.781289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:29.781691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:29.851172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:29.865570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9324927a-69d4-442b-a2ac-37ccfeec5a2b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097207 Nov 19 19:46:29.866652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1271/2487] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:29 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:29.974219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:29.975170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:29.982972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:29.983419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:29.984250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:29.984686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:30.022517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-013d9857-0d13-421b-a465-6f3eb7ebddf4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052351 Nov 19 19:46:30.023031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1217/2488] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:30.890787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:30.891890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:30.899090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:30.899540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:30.900324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:30.900755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:30.965455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:30.974851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-33c9acf0-4b3b-4177-aa1f-c7ae3a2eda03 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087786 Nov 19 19:46:30.975468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1272/2489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:31.035357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:31.036347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:31.043855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:31.044313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:31.045130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:31.045562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:31.080840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-901f76d4-62dc-42c8-a257-2e713536e795 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049692 Nov 19 19:46:31.081462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1218/2490] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:32.002985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:32.003844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:32.011133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:32.011605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:32.012405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:32.012861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:32.092996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:32.093943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:32.102218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:32.102617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:32.102805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:32.103484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:32.103923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:32.115889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-99a75b96-ca86-4687-8bc6-7c8248cddb04 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.116494 Nov 19 19:46:32.116792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1273/2491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:32.143206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-372c6cd1-da45-4f26-aeab-34230646df51 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054468 Nov 19 19:46:32.143812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1219/2492] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:46:33.136800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:33.137565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:33.145915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:33.146467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:33.147492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:33.147969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:33.158437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:33.159955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:33.170756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:33.171462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:33.172756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:33.173424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:33.232771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:33.237107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6fae99da-953d-413d-b361-7f8ceaadc837 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084293 Nov 19 19:46:33.237981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1220/2493] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:33.243347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8999f5a-0a86-4595-b0c8-c89f72107e78 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.110832 Nov 19 19:46:33.243973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1274/2494] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:34.250998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:34.251974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:34.259241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:34.259716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:34.260519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:34.260976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:34.267106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:34.268305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:34.279945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:34.280722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:34.282180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:34.282982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:34.295251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-47a9167e-85b5-4112-a0f5-f65037e18a5e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048496 Nov 19 19:46:34.295915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1221/2495] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:34 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:34.371408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:34.380567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ed16319d-080c-469e-b0eb-1723b977497f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.119992 Nov 19 19:46:34.381146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1275/2496] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:35.308626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:35.309564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:35.317195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:35.317644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:35.318508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:35.318942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:35.354844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-72045d2b-1646-455d-9d66-a33b438efec2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050364 Nov 19 19:46:35.355461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1222/2497] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:35.400189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:35.400836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:35.408400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:35.408851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:35.409650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:35.410114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:35.480609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:35.494455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-836a9bc9-ef04-47b0-9d8a-d4184facef8d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.098237 Nov 19 19:46:35.495494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1276/2498] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:36.367572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:36.368485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:36.375621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:36.376066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:36.376871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:36.377300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:36.411082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e6cf8536-4144-4f9e-8b2d-2206b4b2ea9a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047368 Nov 19 19:46:36.411675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1223/2499] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:36.521406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:36.521997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:36.529229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:36.529688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:36.530520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:36.530953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:36.604244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:36.613227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af0217aa-542a-4758-8d75-3aa5ad1fc7fe tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096765 Nov 19 19:46:36.613824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1277/2500] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:37.423447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:37.424451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:37.431816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:37.432256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:37.433012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:37.433476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:37.468802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e22f3b87-2c92-433f-9bcd-38e38ef67948 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049268 Nov 19 19:46:37.469910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1224/2501] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:37.631581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:37.632297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:37.639406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:37.639913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:37.640751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:37.641223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:37.726289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:37.734398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-77a3240c-0b44-41a0-86d1-80db6f68b29d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.106728 Nov 19 19:46:37.735173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1278/2502] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:38.481408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:38.482336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:38.489961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:38.490588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:38.491629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:38.492150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:38.528904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c8e6b5a-377d-470f-9ea9-f0bed6081e08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051032 Nov 19 19:46:38.529627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1225/2503] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:38.758343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:38.758981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:38.766257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:38.766721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:38.767542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:38.767982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:38.837852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:38.847143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4973396-4dd8-445e-a7a1-0a64bdd15b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092517 Nov 19 19:46:38.847754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1279/2504] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:39.543502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:39.544322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:39.551761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:39.552208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:39.552994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:39.553421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:39.756057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-afc52732-5d33-4d16-b7df-c19dd0f376ec tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.216058 Nov 19 19:46:39.757085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1226/2505] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:39.865117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:39.865704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:39.872748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:39.873200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:39.873994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:39.874464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:39.940295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:39.948420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-426ab989-2b66-4d08-959e-6c61ba0cedba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087134 Nov 19 19:46:39.948994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1280/2506] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:39 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:40.772472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:40.774112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:40.785033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:40.785817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:40.787226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:40.788006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:40.824663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-414069be-addf-422a-b27a-7b914edd1c70 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059195 Nov 19 19:46:40.825380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1227/2507] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:40.965590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:40.966369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:40.975018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:40.975602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:40.976631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:40.978196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:41.045058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:41.053407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c4fde0f5-66ce-4154-a411-53367fb0fef0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092049 Nov 19 19:46:41.053970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1281/2508] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:41.837446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:41.838417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:41.846244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:41.846694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:41.847540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:41.847973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:41.882655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b7dc025-9cfb-4356-9a1b-3bd47c9ec8ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049099 Nov 19 19:46:41.883240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1228/2509] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:41 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:42.070999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:42.071647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:42.079358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:42.079852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:42.080763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:42.081196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:42.164115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:42.172877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-59010bc7-aefb-4081-8e67-4c48de91208b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.105551 Nov 19 19:46:42.173469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1282/2510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:42.895403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:42.896330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:42.903299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:42.903744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:42.904541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:42.904967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:42.938016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d580cb5-6323-4c88-8c48-379e5591a675 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046482 Nov 19 19:46:42.938956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1229/2511] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:42 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:43.190934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:43.191517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:43.198221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:43.198665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:43.199441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:43.199866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:43.268736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:43.277025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39ff407a-73d3-4caa-a3c8-b4dad5fe1cf7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090069 Nov 19 19:46:43.277614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1283/2512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:43.953401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:43.954752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:43.962029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:43.962508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:43.963298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:43.963724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:43.997269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a377a76c-4cd7-4e6f-9949-71c782374d89 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049218 Nov 19 19:46:43.997840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1230/2513] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:43 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:44.301098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:44.302113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:44.309985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:44.310588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:44.311418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:44.311912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:44.375517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:44.384390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-161fe3f1-1022-4747-993e-6f2816b68161 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087398 Nov 19 19:46:44.384977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1284/2514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:44 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:45.009423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:45.010455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:45.018014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:45.018630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:45.019529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:45.019961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:45.053943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-19d7a61f-164c-41a9-8e40-f902b5bcea75 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048577 Nov 19 19:46:45.054551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1231/2515] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:45 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:45.402934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:45.403629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:45.411060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:45.411512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:45.412284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:45.412717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:45.482884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:45.491309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a69d9dfc-855b-40d7-a4f2-3f126ff52ecf tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091992 Nov 19 19:46:45.491844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1285/2516] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:45 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:46.065650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:46.066672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:46.074470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:46.074910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:46.075721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:46.076148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:46.116548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-706a4a5d-100a-4402-be10-4b2ad75c2fe1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055133 Nov 19 19:46:46.117254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1232/2517] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:46.510995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:46.511640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:46.518603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:46.519091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:46.519884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:46.520319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:46.584448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:46.596845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-024e557f-ddf7-4e16-b0e8-b2b47d79ec69 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089159 Nov 19 19:46:46.597847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1286/2518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:46 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:47.129270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:47.130233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:47.137755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:47.138264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:47.139131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:47.139495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:47.175409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d1ce2d0c-b194-44db-9577-3ad73113d340 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049778 Nov 19 19:46:47.175598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1233/2519] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:47 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:47.619647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:47.620409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:47.628385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:47.628722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:47.629363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:47.629789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:47.698787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:47.707837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-05818d8d-e5a7-4492-acff-99b4f90595f0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092115 Nov 19 19:46:47.708512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1287/2520] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:47 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:48.189547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:48.190538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:48.198788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:48.199572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:48.200553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:48.200993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:48.238652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9d40558-83c2-4021-876b-01cb68d90b50 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054571 Nov 19 19:46:48.239249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1234/2521] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:48.726275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:48.726961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:48.734144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:48.734656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:48.735500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:48.736056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:48.803979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:48.812593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f16e8b0a-6f0d-47c1-9cee-4619650fe2c2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090131 Nov 19 19:46:48.813555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1288/2522] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:48 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:49.251571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:49.252943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:49.261249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:49.261830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:49.262902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:49.263511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:49.300279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3ec7b64f-c6d7-44d6-856b-d497dce4d5fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053211 Nov 19 19:46:49.300871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1235/2523] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:49 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:49.831034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:49.831674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:49.838513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:49.838956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:49.839750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:49.840176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:49.909877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:49.918327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e70c4d7-59dc-4a03-9515-85d00491bfc3 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091326 Nov 19 19:46:49.918941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1289/2524] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:49 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:50.313990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:50.315304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:50.323493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:50.323964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:50.324772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:50.325214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:50.360975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-006db7f6-e745-41e2-b7b3-cdb9395b9324 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051460 Nov 19 19:46:50.361894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1236/2525] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:50 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:50.936668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:50.937416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:50.945260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:50.945700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:50.946562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:50.946996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:51.019114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:51.028263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52acc702-9551-4f90-a440-399235f73e64 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095388 Nov 19 19:46:51.028876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1290/2526] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:50 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:51.375407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:51.376374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:51.383832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:51.384310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:51.385137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:51.385600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:51.420760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02a54598-494a-40ef-85cb-15aa60902aa9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049234 Nov 19 19:46:51.421338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1237/2527] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:51 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:52.057236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:52.058470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:52.070693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:52.071436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:52.072935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:52.073867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:52.162933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:52.171425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-584bef02-5c97-4a11-8d17-e71c5f876f56 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.121415 Nov 19 19:46:52.173016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1291/2528] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:52 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:52.437021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:52.438753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:52.450781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:52.451555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:52.452937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:52.453714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:52.489725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7f12143-49cf-405a-914f-67b884c32043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.058526 Nov 19 19:46:52.490352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1238/2529] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:52 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:53.194485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:53.195663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:53.207943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:53.208745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:53.210222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:53.211003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:53.308619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:53.317749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d82c333-c942-40d4-89ff-82d354810db9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.131058 Nov 19 19:46:53.318549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1292/2530] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:53 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:53.502843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:53.503776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:53.511131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:53.511413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:53.512226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:53.512644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:53.547747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11eaba69-7525-4d52-b036-5045a371f5a2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049315 Nov 19 19:46:53.548556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1239/2531] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:53 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:54.334909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:54.335583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:54.342980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:54.343444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:54.344267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:54.344700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:54.427807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:54.435949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-379ce39e-ecd2-4bae-84f5-b57af7c647b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104738 Nov 19 19:46:54.436538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1293/2532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:54 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:46:54.560594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:54.561592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:54.569141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:54.569585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:54.570444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:54.570874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:54.612631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b3e5c2a3-562f-4d17-9ecc-38e6c40e2bbd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056020 Nov 19 19:46:54.613301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1240/2533] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:54 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:55.453668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:55.454417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:55.461458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:55.461943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:55.462769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:55.463197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:55.532734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:55.541284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3674b1c6-94a7-4299-906c-bd7d17aea5a8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091318 Nov 19 19:46:55.541946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1294/2534] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:55 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:55.625560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:55.626612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:55.634114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:55.634657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:55.635633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:55.636110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:55.672186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f09b265a-3891-424d-820e-f0e6fc87b66d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050542 Nov 19 19:46:55.672804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1241/2535] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:55 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:56.559992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:56.560894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:56.572058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:56.572847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:56.574319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:56.575121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:56.651452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:56.660728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b59375c1-1c88-4fbd-af66-26500fe81b86 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104677 Nov 19 19:46:56.661633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1295/2536] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:56 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:56.685242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:56.686284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:56.693694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:56.694159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:56.694973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:56.695413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:56.730184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40ad393a-0af7-4bae-8a3c-4253e61c6e49 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048787 Nov 19 19:46:56.730908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1242/2537] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:56 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:57.682209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:57.683057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:57.692231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:57.692764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:57.693695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:57.694292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:57.744490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:57.745791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:57.754220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:57.754818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:57.755732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:57.756256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:57.763857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:57.773378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9c2b03f2-94bb-4b52-a507-0acbe039b362 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097346 Nov 19 19:46:57.774130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1296/2538] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:57 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:57.792953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c45329a-6389-4cb5-b29e-13b16624dcc1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053553 Nov 19 19:46:57.793559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1243/2539] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:57 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:46:58.792886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:58.793612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:58.801171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:58.801630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:58.802469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:58.802905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:58.807822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:58.809337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:58.820829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:58.821646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:58.823018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:58.823808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:58.874717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:46:58.876741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c1cd380-82e6-4426-92c0-537660c2a45e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.075091 Nov 19 19:46:58.877646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1244/2540] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:58 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:46:58.886190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43873b3a-082a-44d7-8f1e-2d5bce56fa8b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.097002 Nov 19 19:46:58.886796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1297/2541] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:58 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:46:59.891387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:59.892482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:59.900167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:59.900761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:59.901815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:59.902389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:59.908461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:46:59.909582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:46:59.921063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:59.922574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:59.924023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:46:59.924791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:46:59.941190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-440812cd-4aa7-4cae-b74b-da8142bfe750 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053391 Nov 19 19:46:59.942257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1245/2542] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:46:59 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:00.000205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:00.008868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8a922c1c-8bec-450d-9d00-31db95c53852 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107480 Nov 19 19:47:00.009463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1298/2543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:46:59 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:47:00.959297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:00.961023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:00.973387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:00.974231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:00.975594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:00.976425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:01.027673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:01.028449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:01.035583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:01.036023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:01.036843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:01.037005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b5ec966-2676-4533-a649-fafc9e63c4fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084715 Nov 19 19:47:01.037269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:01.039121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1246/2544] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:00 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:01.117648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:01.127187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d08c667-fa33-4e1d-acdd-610a36838c23 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104010 Nov 19 19:47:01.127986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1299/2545] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:01 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:47:02.057317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:02.058987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:02.070939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:02.071742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:02.073150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:02.073921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:02.112002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2447097e-66af-4973-ac25-ecb4ea263c7a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062172 Nov 19 19:47:02.112611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1247/2546] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:02 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:02.145020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:02.145649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:02.152518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:02.152952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:02.153729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:02.154195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:02.237398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:02.245988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6d9499fe-93cf-4132-9661-ef5b8da492c7 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104686 Nov 19 19:47:02.246619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1300/2547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:02 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:03.124561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:03.125807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:03.133248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:03.133700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:03.134645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:03.135060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:03.170441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-136cb774-af53-46c4-a6cb-0aa01d383fb0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049698 Nov 19 19:47:03.171048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1248/2548] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:03 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:03.263886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:03.264778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:03.272978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:03.273622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:03.274605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:03.275143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:03.345976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:03.354613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3fc2427c-93c9-43db-ade7-1c3277474d81 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094562 Nov 19 19:47:03.355214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1301/2549] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:03 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:04.185283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:04.186259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:04.193730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:04.194232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:04.195034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:04.195459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:04.231524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3befca2f-7201-4ad3-b52a-7d55abb9a7b5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050202 Nov 19 19:47:04.232307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1249/2550] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:04 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:47:04.373213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:04.373983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:04.381270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:04.381720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:04.382565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:04.383000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:04.471698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:04.479959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-42a81d1c-6cb3-41b0-9476-a45f25e091bc tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.110583 Nov 19 19:47:04.480609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1302/2551] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:04 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:05.245419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:05.246427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:05.255691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:05.255961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:05.256775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:05.257210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:05.300522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3d67802d-9ffb-47a6-ace9-827c9c23273e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059676 Nov 19 19:47:05.302205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1250/2552] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:05 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:05.501184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:05.502299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:05.513327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:05.514084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:05.515945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:05.516675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:05.605981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:05.614955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-55d6185a-6186-4cb2-b22b-ad16b7d08fc4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.120635 Nov 19 19:47:05.615569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1303/2553] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:05 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:06.319900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:06.320913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:06.331939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:06.332391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:06.333201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:06.333634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:06.369076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e536c6f-7881-4428-bdd1-f8141c33b00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054457 Nov 19 19:47:06.369815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1251/2554] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:06 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:06.635865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:06.636913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:06.648524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:06.649329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:06.650937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:06.651699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:06.743671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:06.752976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cf670b6a-07e0-4598-9b39-1dc46143c1c6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.123592 Nov 19 19:47:06.753635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1304/2555] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:06 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:07.381647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:07.382627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:07.389606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:07.390071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:07.390986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:07.391431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:07.425578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7aa37231-3b8a-4114-8bd6-0263b4dc8972 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047772 Nov 19 19:47:07.426195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1252/2556] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:07 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:47:07.770380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:07.771422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:07.778544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:07.779127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:07.780370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:07.780979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:07.848054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:07.856705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8881f49-7d5c-4e69-a9d7-5abea3762b15 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090309 Nov 19 19:47:07.857348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1305/2557] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:07 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:08.437588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:08.438552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:08.445866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:08.446350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:08.447178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:08.447613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:08.483707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b02ac2fe-252e-4205-b7d0-d33536a7ecdb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050109 Nov 19 19:47:08.484489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1253/2558] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:08 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:08.874702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:08.875531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:08.882218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:08.882662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:08.883444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:08.883857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:08.948404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:08.956747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b7119ecb-ddc6-428a-b3ef-82e53ffd6ffb tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.085712 Nov 19 19:47:08.957344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1306/2559] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:08 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:47:09.500505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:09.502229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:09.516459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:09.516917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:09.517948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:09.518480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:09.553382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b8c8b2f-cd3e-4734-a1a6-8d680e2ba3c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060270 Nov 19 19:47:09.553980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1254/2560] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:09 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:09.975020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:09.975705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:09.983443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:09.983914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:09.984682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:09.985260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:10.062809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:10.075895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d7a8d0aa-eccc-4bf5-91b5-be3732f82703 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.104262 Nov 19 19:47:10.076925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1307/2561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:09 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:10.566275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:10.567188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:10.574919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:10.575522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:10.576551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:10.587927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:10.624079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-18ddcb8c-2c43-4618-a5b4-a5aa80c9bd92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.062645 Nov 19 19:47:10.625999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1255/2562] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:10 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:11.096405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:11.097031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:11.103997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:11.104452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:11.105250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:11.105688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:11.175133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:11.184990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cfedf03d-c3fe-46e4-bd56-41d00c4a68b4 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093777 Nov 19 19:47:11.185673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1308/2563] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:11 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:11.637004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:11.637938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:11.645503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:11.645961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:11.646808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:11.647253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:11.682630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fb38b774-2074-4c9a-88e5-f64912f5966c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049544 Nov 19 19:47:11.683205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1256/2564] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:11 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:12.203015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:12.203652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:12.210640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:12.211066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:12.211871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:12.212302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:12.298011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:12.307501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32332b4d-beec-4721-8026-37b371bb2a52 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.107354 Nov 19 19:47:12.307501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1309/2565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:12 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:12.695216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:12.696152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:12.703715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:12.704152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:12.704960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:12.705397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:12.739144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6f7abee9-59ab-403e-9dbe-69c184d85617 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047863 Nov 19 19:47:12.739727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1257/2566] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:12 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:13.324070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:13.324711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:13.333314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:13.333766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:13.334618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:13.335054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:13.405053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:13.413581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9c86e02-cfab-4f3d-a634-0b4684029b9f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093338 Nov 19 19:47:13.414213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1310/2567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:13 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:13.751519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:13.752451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:13.759498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:13.759947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:13.760762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:13.761199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:13.795070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a664b2a4-8812-4baa-8863-2c0f0d59f96b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047327 Nov 19 19:47:13.795737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1258/2568] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:13 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:14.431687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:14.432367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:14.439915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:14.440371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:14.441205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:14.441642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:14.510531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:14.519812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4747415c-5296-4ed1-8dd1-eb140724f8d9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092088 Nov 19 19:47:14.520496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1311/2569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:14 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:14.808513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:14.809939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:14.817402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:14.817858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:14.818694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:14.819129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:14.852775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b082e4bf-595e-4889-86f1-b62f07248f93 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048963 Nov 19 19:47:14.853376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1259/2570] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:14 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:15.537783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:15.538471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:15.545694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:15.546189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:15.547121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:15.547555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:15.614658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:15.623612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-50082940-b50a-4814-95fd-744a96426f27 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089808 Nov 19 19:47:15.624440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1312/2571] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:15 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:15.866008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:15.867236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:15.875494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:15.876105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:15.877237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:15.877809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:15.913041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ba5abb1-b76f-4198-9188-eeb0d04fc94b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051055 Nov 19 19:47:15.913825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1260/2572] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:15 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:16.597149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:47:16.597149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:47:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:47:16.643041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:16.643758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:16.651114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:16.651640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:16.652483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:16.652964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:16.719899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:16.728189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-055a43dc-f141-416a-9611-7144d78218b8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089390 Nov 19 19:47:16.728782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1313/2573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:16 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:16.926474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:16.927335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:16.934839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:16.935291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:16.936098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:16.936539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:16.973481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e98a2582-0f25-4903-944d-98f7c8d0e40a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052008 Nov 19 19:47:16.974071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1261/2574] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:16 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:17.747479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:17.748245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:17.755400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:17.755848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:17.756675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:17.757111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:17.826258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:17.834950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-622e8510-17bb-4084-ae83-8599ad8e47ba tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092074 Nov 19 19:47:17.835522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1314/2575] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:17 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:17.986171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:17.987134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:17.994500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:17.995009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:17.995856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:17.996320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:18.032059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e22cc672-e01c-41d4-8e94-cf9eaaf5fde5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050014 Nov 19 19:47:18.032536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1262/2576] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:17 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:18.857079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:18.857796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:18.865129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:18.865580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:18.866420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:18.866856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:18.935028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:18.944670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52de29a1-7a91-4a99-8ac9-be2c8e795395 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091265 Nov 19 19:47:18.945260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1315/2577] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:18 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:19.045250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:19.046587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:19.054643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:19.055067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:19.055869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:19.056307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:19.091251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ddd6877b-eee3-4451-9592-d92b36b96547 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049988 Nov 19 19:47:19.092680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1263/2578] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:19 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:19.969382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:19.970189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:19.977491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:19.977952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:19.978801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:19.979246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:20.049451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:20.058507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4c3a05bf-7159-40c0-891a-055b32406cb1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093303 Nov 19 19:47:20.059182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1316/2579] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:19 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:20.110472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:20.111954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:20.123025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:20.123722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:20.124952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:20.125669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:20.170966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a45dbdad-43e9-4295-930c-2805ad1f819b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067384 Nov 19 19:47:20.171734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1264/2580] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:20 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:21.076974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:21.077667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:21.085400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:21.085822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:21.086703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:21.087137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:21.155065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:21.163812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e62e68dc-65a8-4038-b5ff-9b2e8d70828d tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090876 Nov 19 19:47:21.164394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1317/2581] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:21 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:21.185337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:21.186310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:21.193818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:21.194360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:21.195180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:21.195715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:21.232415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-18727ecd-d29f-45a8-98f5-91a226a8fea0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051014 Nov 19 19:47:21.233057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1265/2582] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:21 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:22.183582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:22.184290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:22.191713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:22.192170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:22.192985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:22.193420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:22.250204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:22.252452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:22.263323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:22.264318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:22.264877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:22.266437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:22.267204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:22.272075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27720282-c03e-4a69-b500-fe69e412c619 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.094421 Nov 19 19:47:22.273026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1318/2583] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:22 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:22.302276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40a913c0-5a69-4622-9a23-71486da8c468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059888 Nov 19 19:47:22.302868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1266/2584] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:22 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:23.300590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:23.301830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:23.311472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:23.312296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:23.313257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:23.313809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:23.319068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:23.320752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:23.332216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:23.333007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:23.334556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:23.335255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:23.382173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:23.391191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0b5b3a8e-98ef-4455-8124-0a2481f665a1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079234 Nov 19 19:47:23.392317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1267/2585] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:23 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:47:23.396228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6c39a986-114c-462b-9579-4a10ba725b72 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102797 Nov 19 19:47:23.396841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1319/2586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:23 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:24.406269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:24.407547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:24.415214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:24.416117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:24.416319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:24.416526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:24.417434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:24.417924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:24.424738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:24.425167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:24.425982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:24.426456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:24.462594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc8bcd96-d426-4c3b-aa2c-3a7371eb8363 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059980 Nov 19 19:47:24.463537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1268/2587] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:24 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:24.505545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:24.514656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-80ab1d22-de45-4d80-8940-cb0ad53a550b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.103525 Nov 19 19:47:24.515303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1320/2588] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:24 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:25.476382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:25.477473 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:25.485043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:25.485486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:25.486327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:25.486763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:25.521567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1cabffa3-cedb-4bdc-8a51-2f0a16af06ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049330 Nov 19 19:47:25.522025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1269/2589] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:25 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:25.532724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:25.533720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:25.541153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:25.541596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:25.542409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:25.542852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:25.616179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:25.624465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae268619-d0c6-440a-b053-880be112d38b tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095659 Nov 19 19:47:25.625070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1321/2590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:25 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:26.534341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:26.535164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:26.542583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:26.543176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:26.544017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:26.544446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:26.581178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a10464b-e3f0-4844-b21c-7f461f4f8544 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050981 Nov 19 19:47:26.581763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1270/2591] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:26 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:26.649790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:26.650487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:26.658261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:26.659178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:26.659945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:26.659945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:26.724976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:26.733600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ebf9565-2e8e-47c5-ba27-0f3fcdf58ae6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.087393 Nov 19 19:47:26.734476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1322/2592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:26 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:27.594171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:27.595093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:27.602686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:27.603138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:27.603941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:27.604375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:27.638744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-643baff9-49e9-4578-ba44-2fdc7f1d7af4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049071 Nov 19 19:47:27.639339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1271/2593] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:27 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:27.759136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:27.759826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:27.767708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:27.768155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:27.768957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:27.769393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:27.837634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:27.847565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6afe9572-1f6f-4f57-980d-72937d21b6dd tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.092542 Nov 19 19:47:27.848091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1323/2594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:27 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:28.651264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:28.652103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:28.660047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:28.660654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:28.661622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:28.662122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:28.696816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-51ecb027-b7aa-4e94-954a-14eb061f8414 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049860 Nov 19 19:47:28.697501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1272/2595] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:28 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:47:28.868855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:28.869960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:28.881166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:28.881829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:28.883128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:28.883867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:28.976380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:28.984812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba846371-c430-42ab-9382-9952bbdc5df0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.122704 Nov 19 19:47:28.985503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1324/2596] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:28 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:29.481624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:47:29.481983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:47:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:47:29.709447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:29.710306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:29.718040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:29.718430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:29.719214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:29.719643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:29.747705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:47:29.748012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:47:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments (ip 10.222.0.46) !!! Nov 19 19:47:29.767455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-61021e9f-6f2a-4141-85f4-fee7a8a7cf09 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061960 Nov 19 19:47:29.768255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1273/2597] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:29 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:30.009859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:30.010753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:30.017959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:30.018402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:30.019232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:30.019670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:30.089203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:30.098837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba458444-0475-4fbd-8622-d2045b9a82a9 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093506 Nov 19 19:47:30.099426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1325/2598] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:30 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:30.781519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:30.782684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:30.789912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:30.790388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:30.791190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:30.791624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:30.827145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0717a5e6-c845-4560-a7cd-0286da977f9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050098 Nov 19 19:47:30.827740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1274/2599] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:30 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:31.118787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:31.119589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:31.127369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:31.127794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:31.128646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:31.129089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:31.195816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:31.204935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ed6151f-a559-40ab-8be3-e64c6621120f tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.090349 Nov 19 19:47:31.205495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1326/2600] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:31 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:31.841290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:31.842966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:31.850380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:31.850809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:31.851613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:31.852046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:31.885595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbc66218-d43e-4729-82e6-571d58dd3095 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048202 Nov 19 19:47:31.886180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1275/2601] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:31 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:32.223909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:32.224724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:32.234093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:32.234911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:32.236329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:32.237070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:32.334138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:32.343184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2801e31a-1eba-4886-b20a-bb45233a2fc6 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.122295 Nov 19 19:47:32.343534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1327/2602] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:32 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:32.900181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:32.901104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:32.909208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:32.909712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:32.910781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:32.911256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:32.945983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-975e4ccc-809b-4557-a9b9-39431308fe98 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049719 Nov 19 19:47:32.946591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1276/2603] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:32 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:33.360477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:33.361104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:33.368371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:33.368810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:33.369620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:33.370081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:33.443474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:33.452335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-71caf409-e010-4f39-8189-857ee1d44ec8 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.095775 Nov 19 19:47:33.452952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1328/2604] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:33 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:33.958812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:33.959870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:33.967609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:33.968166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:33.968934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:33.969368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:34.004553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-487eda2b-2d86-4230-b368-7dc5adf6ede9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049301 Nov 19 19:47:34.005156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1277/2605] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:33 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:34.470224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:34.470906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:34.478436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:34.478898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:34.479713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:34.480135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:34.571166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:34.580446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-699caec6-bcd3-4149-ab4c-b5e0368ff1b1 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.114448 Nov 19 19:47:34.581012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1329/2606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:34 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:35.018391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:35.019426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:35.027539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:35.028067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:35.028917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:35.029418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:35.065997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23523d96-d1d9-4222-b46b-03cad51566da tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051824 Nov 19 19:47:35.066601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1278/2607] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:35 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:35.604537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:35.605231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:35.612535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:35.612989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:35.613789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:35.614290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:35.683732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:35.692417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c24c71b0-47c0-4751-9985-69cb4beff069 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.091999 Nov 19 19:47:35.693012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1330/2608] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:35 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:36.080023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:36.080951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:36.088139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:36.088583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:36.089383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:36.089813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:36.132287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56e46163-2c33-4f66-90c7-5fe9c80507ee tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056284 Nov 19 19:47:36.133144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1279/2609] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:36 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:36.709718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:36.710534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:36.718334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:36.718767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:36.719600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:36.720015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:36.787099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:36.795711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-751e350e-aa19-4dbc-a522-2c22695e8439 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.089867 Nov 19 19:47:36.796554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1331/2610] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:36 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:37.150679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:37.152322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:37.164065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:37.164857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:37.166280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:37.167119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:37.204659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0e72b5eb-94b0-4b8b-96af-1e81eca8aebf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061160 Nov 19 19:47:37.205250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1280/2611] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:37 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:37.813408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:37.814166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:37.821406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:37.821813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:37.822745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:37.823185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:37.893850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:37.905618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b9eea15-bd53-4a38-b835-92ea3ff4fcc2 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096246 Nov 19 19:47:37.906353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1332/2612] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:37 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:38.219636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:38.220864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:38.228942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:38.229389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:38.230224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:38.230654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:38.264574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1fdc8f1f-bade-4cb7-9372-606fc7b81d0c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049880 Nov 19 19:47:38.265652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1281/2613] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:38 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:38.930946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:38.931669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:38.939854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:38.940500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:38.941396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:38.941924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:39.069315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:39.080177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9c2ce068-ddf7-4409-ba4e-69090dbd9500 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.152950 Nov 19 19:47:39.080756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1333/2614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:38 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:39.283973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:39.285503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:39.303614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:39.304302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:39.307796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:39.308337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:39.348556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-684edb4d-65a4-4b7a-b586-99e99bc5cec9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.072235 Nov 19 19:47:39.349228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1282/2615] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:39 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:39.991583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:47:39.992524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:47:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:47:40.101473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:40.102370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:40.109665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:40.110240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:40.111136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:40.111621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:40.181735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:40.190255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0d7de023-7d1d-48db-b4c8-f301ecd725ac tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.093189 Nov 19 19:47:40.190818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1334/2616] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:40 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:40.364774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:40.365737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:40.373214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:40.373714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:40.374688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:40.375169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:40.410426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c9a8616-6e33-409b-97b3-bd9f4ab06bb5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049528 Nov 19 19:47:40.410993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1283/2617] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 19:47:40 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:47:41.219996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:41.221055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:41.230014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:41.230567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:41.231409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:41.231881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:41.303818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:41.315291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e988d5cc-0071-46f2-ba30-3a53f574efb0 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.102637 Nov 19 19:47:41.315890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1335/2618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:41 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:41.425750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:47:41.427129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:41.434448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:41.434896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:41.435707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:41.436130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:41.462981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d is not ready Nov 19 19:47:41.463616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 409 to user: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d is not ready {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:47:41.464457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4a4c68e3-22db-4160-86ef-457c48b23b21 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action" status: 409 len: 110 microversion: 2.20 time: 0.042714 Nov 19 19:47:41.465021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1284/2619] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:47:41 2021] POST /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d/action => generated 110 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 380 bytes (1 switches on core 0) Nov 19 19:47:42.333533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:42.334513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:42.341788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:42.342659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:42.343486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:42.343902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:42.417293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:42.426391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-98c167ba-591e-43e0-8586-415c9ea0b474 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.096966 Nov 19 19:47:42.426981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1336/2620] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:42 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:43.450907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:43.451536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] [instance: 1894db7d-c20a-4bcc-8fd3-cf13d214a5ae] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:43.459340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:43.459797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:43.460603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:43.461039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:43.610550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '696f302fac2d4ef49c8d6b2826168610', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6216e18ee04d426a8334b064bb569a66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:43.618547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-15d714ae-cab9-4e2e-896b-c7286027cf63 tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae" status: 200 len: 1220 microversion: 2.1 time: 0.172221 Nov 19 19:47:43.619129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1285/2621] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:43 2021] GET /compute/v2.1/servers/1894db7d-c20a-4bcc-8fd3-cf13d214a5ae => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:43.837232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cca0846-0659-44b1-8309-96b94fce19ed tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] Calling method '.version_select at 0x7fc14caf74c0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:43.875197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3cca0846-0659-44b1-8309-96b94fce19ed tempest-TestShelveInstance-223927810 tempest-TestShelveInstance-223927810-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1022611157" status: 202 len: 0 microversion: 2.1 time: 0.044100 Nov 19 19:47:43.876299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1337/2622] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Nov 19 19:47:43 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1022611157 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:47:45.350403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:45.352472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:45.366326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:45.367148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:45.368594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:45.369364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:45.444836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:47:45.652325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f82b5c6-3b09-45e4-8870-6817a8dde694 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 204 len: 0 microversion: 2.1 time: 0.308049 Nov 19 19:47:45.653380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1286/2623] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:47:45 2021] DELETE /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:47:45.667616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:45.669587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:45.685044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:45.686344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:45.688189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:45.689247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:45.767821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bbbe8ae5-20a5-4b20-ba76-b9df3e5aaffc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] Calling method '.version_select at 0x7fc1482f69d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:45.796819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bbbe8ae5-20a5-4b20-ba76-b9df3e5aaffc tempest-TestVolumeBootPattern-803586426 tempest-TestVolumeBootPattern-803586426-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1911179625" status: 202 len: 0 microversion: 2.1 time: 0.036123 Nov 19 19:47:45.798210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1287/2624] 10.222.0.46 () {58 vars in 1262 bytes} [Fri Nov 19 19:47:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1911179625 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:47:46.011101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:46.030612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e82c66e9-ea7f-46a5-8644-9f101d258700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.369232 Nov 19 19:47:46.032182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1338/2625] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:45 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:47.068202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:47.070839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:47.090277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:47.090277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:47.092087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:47.094620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:47.506535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:47.517045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b7db4bd-9d37-4af6-bd5d-ae4d83ec6741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.458968 Nov 19 19:47:47.518295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1288/2626] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:47 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:48.540681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:48.542766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:48.554070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:48.555107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:48.557029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:48.557705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:49.044017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:49.054153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eabfc4ef-8fd3-4c78-b3e3-ab4712fe7ae3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.520097 Nov 19 19:47:49.055075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1339/2627] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:48 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:47:50.075356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:50.076851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:50.087816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:50.088703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:50.089756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:50.090462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:50.709018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:50.720972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-519402d4-8d55-4254-bafb-75160c6ca090 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.650429 Nov 19 19:47:50.721869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1289/2628] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:50 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:51.741746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:51.742621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:51.757284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:51.758083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:51.759926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:51.760557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:52.080638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:52.096337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-add5d5a7-50be-470a-87ac-cadd908bfb4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.360342 Nov 19 19:47:52.110555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1340/2629] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:51 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:47:53.118377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:53.122567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:53.148175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:53.149179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:53.155975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:53.156952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:53.504017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:53.513844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66894663-06f6-489a-b012-9f9ec327249e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.403354 Nov 19 19:47:53.515839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1290/2630] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:53 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:54.537645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:54.539363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:54.551740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:54.552740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:54.554293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:54.555499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:55.193411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:55.224303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9188bbb0-4ca5-4561-b675-ed0e3473ccf1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.693165 Nov 19 19:47:55.238144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1341/2631] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:54 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:56.258329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:56.259418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:56.268285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:56.268759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:56.269663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:56.270231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:56.463676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:56.476318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-db5a1313-110e-44d8-9c84-0a39fbaace6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.228431 Nov 19 19:47:56.477600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1291/2632] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:56 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:57.505484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:57.507879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:57.518680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:57.519847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:57.521472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:57.522610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:57.812955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:57.825760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2471e8e6-671f-41e9-9b28-1008326b2327 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.327082 Nov 19 19:47:57.827465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1342/2633] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:57 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:47:58.848326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:47:58.849074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:47:58.856425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:58.857128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:58.858326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:47:58.859119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:47:59.041870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:47:59.061420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-70796910-3baf-4055-a6bc-f3e045414d4f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.216788 Nov 19 19:47:59.062581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1292/2634] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:47:58 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:00.089930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:00.090607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:00.099160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:00.099962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:00.101021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:00.101540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:00.279913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:00.289326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-15cc5e8c-4f69-4b57-96bd-e48dbdf28f2a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.203999 Nov 19 19:48:00.289935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1343/2635] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:00 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:01.307593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:01.308267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:01.315572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:01.316067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:01.316967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:01.317440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:01.472147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:01.480909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-505d67a0-fcef-4428-bec3-98782639d7b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177150 Nov 19 19:48:01.481480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1293/2636] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:01 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:02.507142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:02.507761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:02.515259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:02.515692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:02.516517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:02.516983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:02.682567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:02.697448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4350d4b8-537b-472a-95cb-05c8b48727f5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.193878 Nov 19 19:48:02.698389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1344/2637] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:02 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:03.723268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:03.723948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:03.730449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:03.730893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:03.731676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:03.732103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:04.131724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:04.140961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8850694c-4034-4ed6-91db-6b8e7251486a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.421482 Nov 19 19:48:04.141556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1294/2638] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:03 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:05.168719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:05.169489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:05.176812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:05.177267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:05.178077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:05.178531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:05.369102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:05.378436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b297b44e-86ab-46d8-9298-51c673c90190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.213579 Nov 19 19:48:05.379019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1345/2639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:05 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:06.396811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:06.397490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:06.404942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:06.405634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:06.406520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:06.407124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:06.563203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:06.578370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd5f24fb-0ec4-4bd0-8b03-b31d331f0de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.185016 Nov 19 19:48:06.579496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1295/2640] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:06 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:07.597647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:07.598589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:07.605582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:07.606027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:07.606859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:07.607285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:07.801318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:07.812622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-776260ff-a445-405e-9306-b8d01763bc36 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.219248 Nov 19 19:48:07.813501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1346/2641] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:07 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:08.833060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:08.833809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:08.841373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:08.842426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:08.843299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:08.843960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:08.996628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:09.010113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f9daa7a-decf-4b6b-a41f-5fcd8f4b43e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180528 Nov 19 19:48:09.011217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1296/2642] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:08 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:10.029347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:10.030341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:10.037537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:10.037984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:10.038824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:10.039264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:10.191547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:10.197411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-13c40578-30ed-4fe0-8945-3417fc519ac1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.172026 Nov 19 19:48:10.198081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1347/2643] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:10 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:11.218706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:11.219703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:11.227102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:11.227550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:11.228338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:11.228788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:11.389268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:11.398028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6a3b9be-2f7c-41e0-a43b-1570ccb2c95d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.186361 Nov 19 19:48:11.398670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1297/2644] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:11 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:12.416295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:12.416947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:12.424843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:12.425279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:12.426081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:12.426542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:12.584195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:12.594863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7b4a7e1-5a3c-4f40-99f2-c96e344407d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.182311 Nov 19 19:48:12.595479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1348/2645] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:12 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:13.614837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:13.615583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:13.623247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:13.623686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:13.624579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:13.625015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:13.784706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:13.793898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-42f9707f-dbe7-4fb4-9177-e3eaa5546450 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.183085 Nov 19 19:48:13.794435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1298/2646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:13 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:14.821946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:14.823103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:14.832626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:14.833047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:14.833926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:14.834326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:15.030233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:15.046166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-22202347-3078-4d96-b39b-a7b4a7ff6c5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.229345 Nov 19 19:48:15.047217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1349/2647] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:14 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:16.064841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:16.065449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:16.073267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:16.073747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:16.074652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:16.075093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:16.228311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:16.237992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cfe1385e-114b-4865-92e3-81edd01f30b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177476 Nov 19 19:48:16.238745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1299/2648] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:17.259029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:17.259825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:17.268287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:17.268758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:17.269742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:17.270274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:17.429181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:17.438436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-290aa08b-88a9-43d5-9580-1f6b38169d76 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.183566 Nov 19 19:48:17.439042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1350/2649] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:17 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:18.456788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:18.457474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:18.464805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:18.465273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:18.466455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:18.466893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:18.630885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:18.640622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07e007f1-61b8-45e3-81e5-9f0c4f5cba08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.187732 Nov 19 19:48:18.641231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1300/2650] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:18 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:19.668092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:19.668741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:19.676406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:19.676885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:19.677680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:19.678167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:19.835153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:19.845908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-137835e0-6ae3-4be6-945e-d5be1365b556 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.181601 Nov 19 19:48:19.846642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1351/2651] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:19 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:20.864681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:20.865367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:20.872672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:20.873148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:20.873939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:20.874403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:21.030657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:21.039752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0b22ab3-707b-4730-99c9-3dc331bee66f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179098 Nov 19 19:48:21.040332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1301/2652] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:20 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:22.057924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:22.058626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:22.066593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:22.067085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:22.067920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:22.068387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:22.223896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:22.233097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6454e3e-6fbd-4750-840d-51040021657c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179060 Nov 19 19:48:22.233678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1352/2653] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:22 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:23.251222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:23.252021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:23.259567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:23.260021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:23.260838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:23.261277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:23.427050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:23.436586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d2c5904a-5871-48b4-80a4-a35c5246d16f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.189003 Nov 19 19:48:23.437199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1302/2654] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:23 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:24.454900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:24.455653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:24.463091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:24.463568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:24.464526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:24.464996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:24.631019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:24.640215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1a6f4109-de65-4fbd-910f-771b2b165741 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.189142 Nov 19 19:48:24.640868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1353/2655] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:25.657496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:25.658209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:25.665743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:25.666253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:25.667073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:25.667509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:25.816393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:25.825542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2f453e4-f7a1-4f98-b1f4-e0132008e9f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.171862 Nov 19 19:48:25.826682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1303/2656] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:25 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:26.844728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:26.845455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:26.852462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:26.852915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:26.853727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:26.854197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:27.011619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:27.020677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1bf5daf4-7cb3-4ce5-bbf1-6e1affb0b83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180145 Nov 19 19:48:27.021262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1354/2657] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:26 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:28.040008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:28.040789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:28.048941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:28.049384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:28.050223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:28.050681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:28.206905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:28.218454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-360f3cfa-ff00-4828-a9e4-bb3a1fcc15fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.182720 Nov 19 19:48:28.219135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1304/2658] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:28 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:29.236277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:29.237019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:29.243538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:29.243986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:29.244821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:29.245250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:29.419009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:29.428939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6273428f-3a7c-443c-9589-4dd307225821 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.196537 Nov 19 19:48:29.429605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1355/2659] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:29 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:30.447676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:30.448451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:30.455759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:30.456207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:30.457000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:30.457427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:30.611908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:30.620966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a061f35-5ce4-4e1b-9773-6a2bd9774ac7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177059 Nov 19 19:48:30.621553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1305/2660] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:31.645013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:31.645736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:31.653361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:31.653806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:31.654755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:31.655188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:31.840053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:31.850208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b0e3b2e1-95eb-411a-ab46-aa1b81db78f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.208937 Nov 19 19:48:31.850812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1356/2661] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:32.875404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:32.876042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:32.883594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:32.884095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:32.884933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:32.885432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:33.061576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:33.071080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-702c3037-88f0-4f20-9105-9210afe7708f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.199671 Nov 19 19:48:33.071940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1306/2662] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:32 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:34.090579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:34.091388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:34.101126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:34.101577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:34.102413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:34.102852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:34.257127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:34.266607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c152371a-0705-45de-b281-097ba92739b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179705 Nov 19 19:48:34.267192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1357/2663] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:34 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:35.283482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:35.284141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:35.291235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:35.291709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:35.292521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:35.292969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:35.449050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:35.457784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1923200f-836a-4884-97a8-6c0271118050 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.178023 Nov 19 19:48:35.458405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1307/2664] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:35 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:36.479059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:36.480269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:36.491554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:36.492350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:36.493793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:36.494623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:36.675759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:36.686412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-305b6b67-738c-473e-bb3d-c9268045ecc3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.213163 Nov 19 19:48:36.687008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1358/2665] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:36 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:37.708077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:37.709134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:37.719415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:37.720034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:37.720979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:37.721495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:37.876377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:37.885313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5d05525-114b-4d2a-864d-af1f7158b0d5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.184392 Nov 19 19:48:37.885903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1308/2666] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:37 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:38.904476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:38.905453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:38.913166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:38.913676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:38.914600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:38.915171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:39.088878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:39.098590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01115575-6419-4b36-bbab-4a3759a0f2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.198137 Nov 19 19:48:39.099203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1359/2667] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:38 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:40.116438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:40.117114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:40.125449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:40.125900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:40.126761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:40.127190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:40.282234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:40.291013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6956e204-10e4-4c2f-8643-6dfd3fa7d99c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.178277 Nov 19 19:48:40.291610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1309/2668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:40 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:41.309174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:41.309917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:41.317569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:41.318066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:41.318883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:41.319317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:41.470456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:41.479079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef731167-cf26-4e4c-b7c1-e5fb646c218e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.173720 Nov 19 19:48:41.479672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1360/2669] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:41 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:42.497828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:42.498581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:42.505848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:42.506253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:42.507077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:42.507512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:42.667653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:42.676950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d0e436da-0d55-4c62-b8ab-daf98c4fe862 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.183271 Nov 19 19:48:42.677550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1310/2670] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:42 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:43.695704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:43.696389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:43.703950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:43.704530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:43.705601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:43.706344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:43.867165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:43.875957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9fb00cd-f662-453f-adf2-14c52e9d73e7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.184248 Nov 19 19:48:43.876548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1361/2671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:43 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:44.894193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:44.894878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:44.902022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:44.902566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:44.903516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:44.903986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:45.079901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:45.088605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81213ee0-3404-481d-8840-717156e8ff0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.198325 Nov 19 19:48:45.089184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1311/2672] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:44 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:46.110323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:46.110977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:46.117638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:46.118076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:46.119077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:46.119352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:46.285064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:46.294655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1b2f5a2-a06d-4a95-8dfa-a19df12d31a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.188839 Nov 19 19:48:46.295245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1362/2673] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:46 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:47.313171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:47.313769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:47.320753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:47.321196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:47.322002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:47.322479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:47.475795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:47.485095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a44d5315-71ed-4d32-b4ad-b25006ccbd5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.176582 Nov 19 19:48:47.485695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1312/2674] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:47 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:48.503771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:48.504462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:48.511474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:48.511917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:48.512802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:48.513239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:48.662441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:48.671322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0f61a620-e78d-4269-ae15-733050489bda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.171454 Nov 19 19:48:48.671950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1363/2675] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:48 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:49.689849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:49.690571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:49.697325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:49.697776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:49.698612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:49.699048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:49.894394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:49.903162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e709af3d-9dd7-4e2e-ae09-d98d62317c4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.217514 Nov 19 19:48:49.904031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1313/2676] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:49 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:50.922011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:50.922678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:50.929845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:50.930342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:50.931150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:50.931583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:51.092782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:51.101918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e83ea34c-91b0-4934-b56a-732116561f7a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.184117 Nov 19 19:48:51.102874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1364/2677] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:50 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:48:52.119642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:52.120299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:52.129260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:52.129711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:52.130553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:52.130988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:52.280407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:52.288601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-469a9400-8fcc-45eb-a432-ae0cd4623fae tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.172686 Nov 19 19:48:52.289179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1314/2678] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:52 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:53.072707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:48:53.073035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:48:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:48:53.309625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:53.310317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:53.321625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:53.322433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:53.323798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:53.324568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:53.598091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:53.606358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1811aec0-e75b-4aba-ad6f-a6a43be65ab4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.301208 Nov 19 19:48:53.606945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1365/2679] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:53 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:54.625369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:54.625993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:54.633305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:54.633738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:54.634581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:54.635006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:54.798711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:54.807328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-204b3153-a3d3-48b4-b2f3-3348b13ea693 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.186146 Nov 19 19:48:54.807912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1315/2680] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:54 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:55.825488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:55.826415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:55.833685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:55.834135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:55.834941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:55.835370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:55.982798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:55.995325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-97e2d7dc-0ce8-4c60-8bfd-841e614eb32e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.173979 Nov 19 19:48:55.996340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1366/2681] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:55 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:57.014594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:57.015264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:57.022094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:57.022561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:57.023347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:57.023771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:57.183045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:57.192294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0f8e9fe8-4e83-4115-b862-14751d1ab2a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.181439 Nov 19 19:48:57.192892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1316/2682] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:57 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:58.210856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:58.211539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:58.220788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:58.221557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:58.222879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:58.223383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:58.379849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:58.388740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c24c498b-6646-48e5-bac0-17a08610d28a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.182541 Nov 19 19:48:58.389328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1367/2683] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:58 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:48:59.406180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:48:59.406956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:48:59.414308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:59.414749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:59.415551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:48:59.415979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:48:59.589988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:48:59.600500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-858891f2-fd1a-4b90-8a05-7211b890592f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.198554 Nov 19 19:48:59.601151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1317/2684] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:48:59 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:00.619081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:00.619703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:00.627443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:00.628011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:00.629093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:00.629565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:00.786380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:00.795358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7f26729c-386b-4ce0-82c6-3885c158bb2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180349 Nov 19 19:49:00.800777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1368/2685] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:00 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:01.827917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:01.828530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:01.835524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:01.835987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:01.836840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:01.837281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:01.982953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:01.991884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f14d4283-8c24-4112-a6ec-cdaa1e807ab8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.168215 Nov 19 19:49:01.992453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1318/2686] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:01 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:03.009195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:03.009813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:03.016788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:03.017236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:03.018027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:03.018486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:03.177063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:03.187197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-20a8e2b0-0538-42bb-b5e2-e925cadc4bce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.181898 Nov 19 19:49:03.187774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1369/2687] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:03 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:04.204892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:04.205538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:04.212619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:04.213122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:04.213942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:04.214409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:04.371750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:04.381275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ec3d4df1-7b85-4c1e-9f7f-4a61aedae02f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180181 Nov 19 19:49:04.381873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1319/2688] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:04 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:05.401727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:05.402538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:05.412898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:05.413649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:05.414831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:05.415504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:05.592739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:05.601954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-533d4d01-3d5d-4b20-a5a2-49f515c61f9d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.206500 Nov 19 19:49:05.602598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1370/2689] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:05 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:06.620715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:06.621325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:06.629366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:06.629814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:06.630656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:06.631091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:06.789943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:06.799776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40fd42c0-18ee-4674-b07f-07b456320a5c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.183086 Nov 19 19:49:06.800446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1320/2690] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:06 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:07.821215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:07.821911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:07.829366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:07.829896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:07.830722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:07.831157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:08.043836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:08.054678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1b2663d7-c550-45d0-bcc9-7c6b506c5695 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.237323 Nov 19 19:49:08.055600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1371/2691] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:07 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:09.081488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:09.082545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:09.090362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:09.090845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:09.091706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:09.092503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:09.251683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:09.260312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dcc21a22-ef11-45d3-aeb4-5712cf90229e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.182934 Nov 19 19:49:09.260900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1321/2692] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:09 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:10.277501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:10.278322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:10.285116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:10.285558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:10.286362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:10.286790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:10.435291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:10.444475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f81f4ff8-f5fa-4228-83c4-68ad08c332ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.170664 Nov 19 19:49:10.445061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1372/2693] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:10 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:11.463029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:11.463766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:11.470966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:11.471388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:11.472190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:11.472627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:11.660580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:11.671082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-53336fa5-fbf6-4e9f-9f30-a73a7d51424b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.211853 Nov 19 19:49:11.671872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1322/2694] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:11 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:12.697646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:12.698271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:12.705614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:12.706077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:12.706892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:12.707326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:12.855977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:12.864476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f67d4a22-43c1-414f-a806-3ee0f05f800b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.170967 Nov 19 19:49:12.865060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1373/2695] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:12 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:13.882427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:13.883076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:13.890138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:13.890746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:13.891686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:13.892124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:14.042408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:14.056897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2cecd5e1-907a-40ec-a8c1-e6b640d72d48 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177921 Nov 19 19:49:14.057954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1323/2696] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:13 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:15.074935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:15.075646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:15.082408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:15.082849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:15.083628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:15.084052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:15.243575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:15.253085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0fa1e032-0c7f-4223-851b-7f6d885b120c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.182579 Nov 19 19:49:15.253674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1374/2697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:15 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:16.270376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:16.271040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:16.278121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:16.278608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:16.279420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:16.279851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:16.430360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:16.440792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52cef7cf-5efc-4818-96c7-3120f8e7cd41 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.174098 Nov 19 19:49:16.441385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1324/2698] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:17.458874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:17.459473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:17.467635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:17.468231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:17.469213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:17.469736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:17.629456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:17.638972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ebee013-decf-40e1-b1e4-d04bbe1ce3c6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.183971 Nov 19 19:49:17.639601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1375/2699] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:17 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:18.657366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:18.658126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:18.665742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:18.666326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:18.667323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:18.667905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:18.824221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:18.833263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6bf39eb8-4f24-4212-ae9f-9e10cb591931 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180203 Nov 19 19:49:18.833849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1325/2700] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:18 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:19.852032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:19.852816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:19.860742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:19.861182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:19.861983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:19.862449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:20.017152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:20.027944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c16a3bc0-7b1d-4be5-ab2b-60138b595d8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179821 Nov 19 19:49:20.028813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1376/2701] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:19 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:21.053749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:21.054471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:21.061818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:21.062299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:21.063094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:21.063522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:21.223161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:21.232736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9757f031-6846-4bad-a7d3-13387d23d7e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.182626 Nov 19 19:49:21.233348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1326/2702] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:21 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:22.259802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:22.260491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:22.268521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:22.269015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:22.269861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:22.270387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:22.421040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:22.429760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-16d7a17e-6398-41a8-94bf-6758d7140fe1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.173686 Nov 19 19:49:22.430409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1377/2703] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:22 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:23.447262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:23.447878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:23.455757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:23.456212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:23.457025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:23.457461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:23.619236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:23.634359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59a7470d-9829-463e-b0bf-0c4b5ce24ad7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.190687 Nov 19 19:49:23.635246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1327/2704] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:23 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:24.380142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:49:24.380844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:49:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:49:24.653214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:24.653901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:24.661374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:24.661826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:24.662668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:24.663100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:24.819587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:24.828752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bfbff1ca-1e90-4044-bace-b2ed89c837a9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179818 Nov 19 19:49:24.829350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1378/2705] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:25.849459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:25.850159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:25.858426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:25.858875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:25.859682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:25.860117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:26.024756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:26.035014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-80845c70-2af9-4155-99f1-f6dc7f4ff38d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.189225 Nov 19 19:49:26.035859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1328/2706] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:25 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:27.054616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:27.055241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:27.063616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:27.064081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:27.064868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:27.065319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:27.216307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:27.225485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0b82128e-faa3-4a9f-87a1-90e7dc319d12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.174616 Nov 19 19:49:27.226105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1379/2707] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:27 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:28.243215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:28.244010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:28.251059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:28.251502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:28.252291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:28.252841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:28.399894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:28.414954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-790b1720-d096-4f13-9be7-38fbac4b1270 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.175000 Nov 19 19:49:28.415936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1329/2708] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:28 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:29.441063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:29.441648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:29.448184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:29.448636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:29.449689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:29.450361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:29.639190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:29.648263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c01c8144-1d5f-41f1-827b-c5b86751a0e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.211046 Nov 19 19:49:29.648874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1380/2709] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:29 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:30.675232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:30.675916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:30.683625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:30.684778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:30.685760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:30.686201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:30.836566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:30.846071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d259bc2a-5a7d-40db-9547-b51baa3289a4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.175313 Nov 19 19:49:30.846668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1330/2710] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:31.864792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:31.865471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:31.873517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:31.873970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:31.874809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:31.875242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:32.031925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:32.040859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee952c82-ffa0-401b-ad38-5514fc5f8a54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180157 Nov 19 19:49:32.041550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1381/2711] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:33.059575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:33.060276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:33.067096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:33.067529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:33.068329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:33.068757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:33.222538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:33.231558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f1e9f61-57ac-496e-9612-ee03d7e4ec05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.176096 Nov 19 19:49:33.232425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1331/2712] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:33 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:34.250619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:34.251319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:34.258178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:34.258628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:34.259422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:34.259853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:34.432972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:34.441876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1c2262a2-6beb-4faa-af8b-d8b934048727 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.195554 Nov 19 19:49:34.442519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1382/2713] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:34 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:35.459502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:35.460105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:35.467881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:35.468356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:35.469151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:35.469591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:35.620104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:35.628951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-42de2e87-4767-4d52-9aea-1e9247bdb880 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.173199 Nov 19 19:49:35.629534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1332/2714] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:35 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:36.651624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:36.652890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:36.664507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:36.665432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:36.667056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:36.667969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:36.834589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:36.844050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-56d6aeed-8002-4379-82e0-3fefbcb32bf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.198696 Nov 19 19:49:36.844858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1383/2715] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:36 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:37.861282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:37.861948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:37.869423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:37.869862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:37.870679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:37.871119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:38.025079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:38.034410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ae6c766-db92-4828-9106-2695f44990c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.176999 Nov 19 19:49:38.035009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1333/2716] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:37 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:39.055084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:39.055677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:39.063617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:39.064058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:39.064856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:39.065290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:39.246734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:39.255355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04d55cfa-bbae-4c1d-a161-5f096e3e3fb7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.204345 Nov 19 19:49:39.256231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1384/2717] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:39 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:40.273250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:40.273947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:40.281592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:40.282035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:40.282846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:40.283284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:40.444053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:40.454194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f985b94-c962-444b-a889-98cb0fd636c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.184792 Nov 19 19:49:40.454807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1334/2718] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:40 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:41.472654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:41.473270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:41.480662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:41.481166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:41.482276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:41.482752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:41.636579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:41.646269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd02a391-f4e5-4c54-b625-c0ef4901b8f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177716 Nov 19 19:49:41.646887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1385/2719] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:41 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:42.664540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:42.665363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:42.673014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:42.673455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:42.674306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:42.674737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:42.823970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:42.838259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f42e60b-689f-49c0-a2ed-055ebc2001e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177510 Nov 19 19:49:42.839062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1335/2720] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:42 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:43.862075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:43.863707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:43.874527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:43.877007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:43.878021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:43.878509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:44.031668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:44.040166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-26e65636-6718-4d17-a76d-97287dedb956 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.184094 Nov 19 19:49:44.040735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1386/2721] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:43 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:45.061011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:45.062203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:45.073446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:45.074223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:45.075697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:45.076399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:45.239885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:45.249557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a01aec99-5157-476a-ad62-e83a27b30384 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.194902 Nov 19 19:49:45.250149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1336/2722] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:45 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:45.845345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:45.846354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:45.853312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:45.853917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:45.854873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:45.855831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:45.898924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:49:45.904765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:45.905318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:45.911664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:45.912178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:45.913047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:45.913706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:45.955716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:49:46.021150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6e7bc9ae-71b9-4481-b22f-4bdef501e268 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 204 len: 0 microversion: 2.1 time: 0.179559 Nov 19 19:49:46.024809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1387/2723] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:49:45 2021] DELETE /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:49:46.036113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:46.036832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:46.049673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:46.050535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:46.051861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:46.052563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:46.054579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ad07f2b2-53fe-4cf8-ab87-8ec869ad63e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 204 len: 0 microversion: 2.1 time: 0.153842 Nov 19 19:49:46.055389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1337/2724] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:49:45 2021] DELETE /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:49:46.066648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:46.067928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:46.075871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:46.076330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:46.077152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:46.077595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:46.284586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:46.295011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:46.295340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d97b4887-3f2b-4857-a5ec-c69de948e47e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1513 microversion: 2.1 time: 0.265142 Nov 19 19:49:46.295617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1388/2725] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:46 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1513 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:46.300380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:46.301012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:46.307553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:46.308097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:46.309656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:46.310118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:46.310382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9891a22e-bab6-4b24-abb2-525b56c6997f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.248190 Nov 19 19:49:46.311052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1338/2726] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:46.515355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:46.523610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f391ce85-32a1-41e2-9203-14756160aed6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.226830 Nov 19 19:49:46.524207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1389/2727] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:46 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:47.318151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:47.319630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:47.327905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.328681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.339798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.340416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.379912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.380434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.380960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lazy-loading 'fault' on Instance uuid f6c76ce3-c438-4f1b-bbae-6e1de878cf06 {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:49:47.404532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-413b605c-5852-4e22-a872-7726b3760ebf req-1d2e7614-987d-45dc-bed6-a704706a3d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c76ce3-c438-4f1b-bbae-6e1de878cf06", "name": "network-vif-deleted", "tag": "c8491e9e-ce25-4829-9767-b63dc9a7eed5"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:49:47.412423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:49:47.412423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:49:47.418202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-413b605c-5852-4e22-a872-7726b3760ebf req-1d2e7614-987d-45dc-bed6-a704706a3d73 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.419153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-413b605c-5852-4e22-a872-7726b3760ebf req-1d2e7614-987d-45dc-bed6-a704706a3d73 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.433229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-413b605c-5852-4e22-a872-7726b3760ebf req-1d2e7614-987d-45dc-bed6-a704706a3d73 service nova] Creating event network-vif-deleted:c8491e9e-ce25-4829-9767-b63dc9a7eed5 for instance f6c76ce3-c438-4f1b-bbae-6e1de878cf06 on hv-cinder-77703 Nov 19 19:49:47.438641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:47.438949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-413b605c-5852-4e22-a872-7726b3760ebf req-1d2e7614-987d-45dc-bed6-a704706a3d73 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235912 Nov 19 19:49:47.439259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1339/2728] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:49:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:49:47.444632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:47.445334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:47.452187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.452916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.453704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.454339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.454842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cb5fc673-f43e-4baf-a491-d0e9328f33f0 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 200 len: 1308 microversion: 2.1 time: 0.141611 Nov 19 19:49:47.456048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1390/2729] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:47 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 1308 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:47.541442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:47.542610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:47.549258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.549774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.550680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:47.551174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:47.635395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:47.646541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-09a73285-fbb0-435b-947f-333f8f4bc316 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.205595 Nov 19 19:49:47.647341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1340/2730] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:47 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:47.735758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:47.751011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-70793eb8-e64c-4550-8ff5-46f3b0da9b3d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.213470 Nov 19 19:49:47.752517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1391/2731] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:47 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:48.485443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:48.486226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: f6c76ce3-c438-4f1b-bbae-6e1de878cf06] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:48.493624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:48.494072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:48.494916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:48.495644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:48.509700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] HTTP exception thrown: Instance f6c76ce3-c438-4f1b-bbae-6e1de878cf06 could not be found. Nov 19 19:49:48.510324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Returning 404 to user: Instance f6c76ce3-c438-4f1b-bbae-6e1de878cf06 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:49:48.511381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8c62db4-120a-4d17-9926-2d3b72c25aec tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06" status: 404 len: 111 microversion: 2.1 time: 0.034361 Nov 19 19:49:48.511953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1341/2732] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:48 2021] GET /compute/v2.1/servers/f6c76ce3-c438-4f1b-bbae-6e1de878cf06 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:49:48.666641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:48.667287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:48.674112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:48.674933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:48.675697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:48.675841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:48.769014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:48.769638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:48.776979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:48.777607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:48.778641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:48.779072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:48.818478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:48.827979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-86523900-f816-4c41-9aa1-ec514a2164ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166639 Nov 19 19:49:48.828576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1392/2733] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:48.919611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:48.928900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9dfa5b88-f318-4e7b-b39f-ba64950f7cec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.163690 Nov 19 19:49:48.929507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1342/2734] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:48 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:49.845270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:49.845910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:49.853190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:49.853634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:49.854450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:49.855009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:49.947600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:49.948188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:49.955008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:49.955447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:49.956239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:49.956669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:50.016091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:50.024563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62d21cdb-48f3-49ae-a751-156647627be2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.183327 Nov 19 19:49:50.025176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1393/2735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:50.106521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:50.114804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6bfbfd1-9d08-4cb7-8497-96194535324d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.170824 Nov 19 19:49:50.115382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1343/2736] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:49 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:51.042364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:51.045258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:51.050847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:51.051291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:51.052086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:51.052515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:51.134135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:51.134961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:51.142650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:51.143134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:51.143949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:51.144385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:51.224924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:51.233404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2700be09-8d01-4641-8847-1a856cf9bb12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.195032 Nov 19 19:49:51.233973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1394/2737] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:51.306535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:51.314939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a19abc76-6ab8-4b4e-b685-92bc6ae903e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.185388 Nov 19 19:49:51.315497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1344/2738] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:51 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:52.251225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:52.252208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:52.259592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:52.260048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:52.260832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:52.261357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:52.334108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:52.335005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:52.345986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:52.345986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:52.346795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:52.347763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:52.453220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:52.461576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ced1428-67f5-4483-beb1-6d7d8b8f6317 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.213998 Nov 19 19:49:52.462197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1395/2739] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:52 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:52.527211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:52.535920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-221d1ff1-7b99-4eb7-89b5-9271608cc09d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.207013 Nov 19 19:49:52.536485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1345/2740] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:52 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:53.479760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:53.480368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:53.487186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:53.487628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:53.488787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:53.489471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:53.553927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:53.554587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:53.561211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:53.561661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:53.562483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:53.562903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:53.662451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:53.671859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee74b8f7-d100-4a34-8311-065e9066eecb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.195791 Nov 19 19:49:53.672816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1396/2741] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:53.733959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:53.742490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f644af66-165c-4ad4-b07a-4514309a4190 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.192291 Nov 19 19:49:53.743024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1346/2742] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:53 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:54.689612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:54.690215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:54.696914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:54.697367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:54.698221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:54.698858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:54.760206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:54.760817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:54.769844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:54.770287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:54.771097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:54.771564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:54.875053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:54.883591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-36b856f1-1180-4d55-837c-238159976db1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.197632 Nov 19 19:49:54.884179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1397/2743] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:54.942310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:54.950524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d37bc024-cc52-42ab-bacd-1d0b61b62213 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.193891 Nov 19 19:49:54.951068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1347/2744] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:54 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:55.902737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:55.903455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:55.910913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:55.911455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:55.912306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:55.912822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:55.969886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:55.970508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:55.977550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:55.978106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:55.978829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:55.979263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:56.114429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:56.124120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cc8f9bc9-cdb6-48d0-967f-bdac23729b17 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.225147 Nov 19 19:49:56.125270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1398/2745] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:56.178066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:56.187018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-90a7eafd-ffb5-4dab-93aa-9cac9585d203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.221215 Nov 19 19:49:56.187587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1348/2746] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:55 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:57.144529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:57.145145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:57.152652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:57.153090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:57.153862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:57.154318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:57.209684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:57.210764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:57.221775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:57.222346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:57.223191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:57.223648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:57.356801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:57.366180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d12f2b5-2226-4c47-83ef-22b4bcb9e9c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.225282 Nov 19 19:49:57.366767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1399/2747] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:57 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:57.408803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:57.419012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c42ebaf6-b5cd-475f-87a5-c2f74e699b02 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.217039 Nov 19 19:49:57.419604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1349/2748] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:57 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:58.386096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:58.387036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:58.393642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:58.394086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:58.394880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:58.395306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:58.436740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:58.438472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:58.444556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:58.444980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:58.445797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:58.446288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:58.581903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:58.596921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4169248-2bf3-4f73-bfde-0ef5499eefc0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.214499 Nov 19 19:49:58.597976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1400/2749] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:49:58.627263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:58.635661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5310a173-d129-4d21-9ae7-f817474d35e8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.202635 Nov 19 19:49:58.636446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1350/2750] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:58 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:59.624932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:59.625684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:59.632250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:59.632696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:59.633475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:59.633903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:59.652868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:49:59.653509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:49:59.660091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:59.660538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:59.661303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:49:59.661731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:49:59.842159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:59.850331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-765c417a-f810-4c8c-81bc-d76161cb5009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.229175 Nov 19 19:49:59.850496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:49:59.850922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1401/2751] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:49:59.859141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1fb32fd9-abd8-490a-9638-cf467c7ce2d9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.209960 Nov 19 19:49:59.859714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1351/2752] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:49:59 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:00.869347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:00.870005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:00.877125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:00.877746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:00.877880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:00.878338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:00.879126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:00.879555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:00.884785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:00.885240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:00.886078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:00.886560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:01.123517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:01.131256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:01.131881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d187b515-220e-4161-b09e-3ac161094a0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.266231 Nov 19 19:50:01.132476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1402/2753] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:01.139712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-55cc8d90-5036-4b3f-b30c-44444e52f33d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.266693 Nov 19 19:50:01.140290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1352/2754] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:00 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:02.150176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:02.150813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:02.157734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:02.158400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:02.158833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:02.159282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:02.160050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:02.160497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:02.164767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:02.165215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:02.166000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:02.166468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:02.360734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:02.365010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:02.369306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0ba3bf3-98d7-4860-bafb-4bef21d8ae11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223295 Nov 19 19:50:02.370227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1403/2755] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:02.374929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ac499a64-ee40-4cc6-a346-e0660f70b041 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.221897 Nov 19 19:50:02.375531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1353/2756] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:02 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:03.387168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:03.388500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:03.392129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:03.392717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:03.395367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:03.395814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:03.396749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:03.397176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:03.399527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:03.399950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:03.400748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:03.401182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:03.620752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:03.626102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:03.631622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-94eafc12-ec2d-4271-9f89-a110e719c3af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.247997 Nov 19 19:50:03.632398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1404/2757] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:03 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:03.637553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ebd10212-d571-45b2-8d78-dbb4e63e2567 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.249027 Nov 19 19:50:03.638080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1354/2758] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:03 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:04.651098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:04.651729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:04.655515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:04.656124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:04.659868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:04.659868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:04.660233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:04.660429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:04.665777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:04.666258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:04.667196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:04.668056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:04.865011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:04.867867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:04.873463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0606972-6976-4a27-b53c-9fb182a37510 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.226203 Nov 19 19:50:04.874120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1405/2759] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:04.876068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-484e5015-b9f0-42ad-b92c-0e8016778a12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.225374 Nov 19 19:50:04.876605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1355/2760] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:04 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:05.891570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:05.892250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:05.893199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:05.893839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:05.899767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:05.900275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:05.901198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:05.901831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:05.902074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:05.904596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:05.905895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:05.906375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:06.110623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:06.113931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:06.119036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4135b7d6-03e9-4b92-a787-6fc5a0f78e8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.231892 Nov 19 19:50:06.119618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1406/2761] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:06.124070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-447a4927-a307-4998-82f5-28bb6c66b703 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.234507 Nov 19 19:50:06.124636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1356/2762] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:05 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:07.137233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:07.137839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:07.140117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:07.140688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:07.145336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:07.145997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:07.147328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:07.147494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:07.147836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:07.147990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:07.148724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:07.149142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:07.355814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:07.360269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:07.364307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-192feaf1-d3e5-4702-983e-2482607290ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.231210 Nov 19 19:50:07.364908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1407/2763] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:07.368286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5e0cbc2-77fc-4668-a0e0-19302c454b81 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.231849 Nov 19 19:50:07.368836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1357/2764] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:07 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:08.384691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:08.385638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:08.388143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:08.388841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:08.392471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:08.392915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:08.393708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:08.394164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:08.395435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:08.395909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:08.396665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:08.397089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:08.593618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:08.597254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:08.602028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa5dd305-8f41-4858-8e9a-2526f9549343 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223261 Nov 19 19:50:08.602761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1408/2765] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:08.609031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d25af1e2-93a7-4a31-8f7c-9b4cd17c50c4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.226773 Nov 19 19:50:08.609809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1358/2766] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:08 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:09.620470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:09.621174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:09.628818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:09.629263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:09.630076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:09.630687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:09.785249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:09.788018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:09.788625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:09.794085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f5795af-5cbf-4019-9d57-8e15958f493f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.177188 Nov 19 19:50:09.795188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1409/2767] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:09.795317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:09.795562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:09.796349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:09.796778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:09.944625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:09.954336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c4988f17-d60b-4b6e-8a46-de93d81e240b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.331904 Nov 19 19:50:09.954923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1359/2768] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:09 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:10.813537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:10.814239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:10.821197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:10.821640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:10.822445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:10.822870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:10.970406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:10.972356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:10.972983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:10.978621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe1b80d1-9cfe-4790-92ab-cd18c8559e2a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.168809 Nov 19 19:50:10.979068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:10.979470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1410/2769] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:10.979600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:10.980264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:10.980689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:11.130226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:11.138626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f129a348-a1d6-49f7-a97b-d66e35bea22f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.169836 Nov 19 19:50:11.139191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1360/2770] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:10 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:11.997555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:11.998226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:12.005148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:12.005631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:12.006464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:12.006898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:12.144982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:12.154443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2820a24f-154d-49e3-aea5-306577fc54a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.160270 Nov 19 19:50:12.155300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1411/2771] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:12.155426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:12.156000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:12.162862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:12.163311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:12.164109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:12.164652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:12.311186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:12.319807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-69013cb3-63c8-4cf6-bd57-0f83c08c615d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.168149 Nov 19 19:50:12.320381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1361/2772] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:12 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:13.176125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:13.176786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:13.183376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:13.183821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:13.184596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:13.185174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:13.327463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:13.336018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fa28bbe5-f6a4-4ffd-9365-8e88163d76a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166823 Nov 19 19:50:13.336649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:13.337161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1412/2773] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:13.337286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:13.344433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:13.344877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:13.345657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:13.346078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:13.493481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:13.501957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c70c30c3-9e6c-45f3-81b2-82e236b3b516 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.169006 Nov 19 19:50:13.502618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1362/2774] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:13 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:14.354437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:14.355094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:14.362670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:14.363149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:14.363938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:14.364372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:14.506973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:14.515534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-044d6bef-bd13-4c83-90b8-c677cde6e452 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.164759 Nov 19 19:50:14.516175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1413/2775] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:14.519511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:14.520112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:14.526623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:14.527080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:14.527833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:14.528280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:14.685210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:14.693655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71a65d85-71f3-4769-81b4-b6d7f3cead90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.177663 Nov 19 19:50:14.694259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1363/2776] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:14 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:15.535623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:15.536247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:15.545367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:15.546369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:15.547365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:15.547796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:15.700074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:15.709243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c5e4d7c1-9812-4eb5-af5b-16e49ecf06d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.179689 Nov 19 19:50:15.709785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1414/2777] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:15.711712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:15.712456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:15.719523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:15.720090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:15.721201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:15.721837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:15.884933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:15.894398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1d602d59-c93c-4fe5-b703-77c2311d2a58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.186328 Nov 19 19:50:15.894979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1364/2778] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:15 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:16.729389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:16.730232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:16.739364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:16.739917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:16.740700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:16.741152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:16.886005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:16.897994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-78233c54-4e19-430d-86d8-96f5ec806fa1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.174025 Nov 19 19:50:16.898712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1415/2779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:16.911585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:16.912314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:16.918571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:16.919015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:16.919795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:16.920225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:17.069609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:17.077879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0f23eaad-7afa-4a6e-9733-a3585a5e84dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.170050 Nov 19 19:50:17.078485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1365/2780] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:17.916716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:17.917440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:17.924709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:17.925133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:17.925952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:17.926384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:18.069090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:18.078228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f06e4363-8df2-4529-a8e5-617fd1836eb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165145 Nov 19 19:50:18.078824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1416/2781] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:17 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:18.097680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:18.098348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:18.105418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:18.105863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:18.106697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:18.107129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:18.252957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:18.262174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd0f3e1c-21a9-44fd-8cee-2799ffba5003 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.167885 Nov 19 19:50:18.262889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1366/2782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:18 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:19.098704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:19.099334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:19.105915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:19.106390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:19.107185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:19.107595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:19.253343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:19.261845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-03562b1d-278a-4c42-8cda-cc81c770a463 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166773 Nov 19 19:50:19.262474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1417/2783] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:19.285180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:19.285901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:19.292459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:19.292903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:19.293683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:19.294142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:19.464192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:19.474209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-948d7c99-5c02-4a2f-98cd-9a287573b8a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.192593 Nov 19 19:50:19.474832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1367/2784] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:19 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:20.282168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:20.282803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:20.289569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:20.290020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:20.290803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:20.291237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:20.454150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:20.462887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad10c4bd-1234-4fd4-b0d5-2c5ff50e70b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.184393 Nov 19 19:50:20.463514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1418/2785] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:20.491678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:20.492326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:20.499317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:20.499767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:20.500573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:20.501012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:20.645365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:20.653632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fb9692de-9e40-463b-b85b-62562812ce8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.165850 Nov 19 19:50:20.654220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1368/2786] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:20 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:21.481834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:21.482482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:21.489626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:21.490104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:21.490888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:21.491322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:21.641556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:21.652880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-917f0079-c472-470a-9eb6-e57463be49e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175031 Nov 19 19:50:21.653785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1419/2787] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:21.674771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:21.675398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:21.682886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:21.683493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:21.684271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:21.684703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:21.835269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:21.844652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d35097f-5420-45cd-942a-7038822e59f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.176245 Nov 19 19:50:21.845237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1369/2788] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:21 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:22.675548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:22.676126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:22.682834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:22.683285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:22.684083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:22.684491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:22.840374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:22.850125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d84ccd03-c215-49f5-ba5f-7ebf3f438020 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.178420 Nov 19 19:50:22.850710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1420/2789] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:22.864770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:22.865391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:22.872362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:22.872804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:22.873589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:22.874011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:23.028600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:23.037660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1aa89ef-5743-4a1a-ae6f-876c063afa05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.176429 Nov 19 19:50:23.038330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1370/2790] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:22 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:23.868783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:23.869459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:23.876896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:23.877468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:23.878333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:23.878799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:24.032113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:24.046646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d56da91-a589-413a-95f9-18a2376f2dc8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.181298 Nov 19 19:50:24.047790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1421/2791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:24.056739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:24.057657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:24.065483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:24.065942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:24.066801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:24.067241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:24.229501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:24.238413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc141a29-b45e-4170-bdf6-f69319c0acf8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.185496 Nov 19 19:50:24.239012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1371/2792] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:25.071939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:25.072581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:25.080370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:25.080818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:25.081622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:25.082073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:25.255962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:25.257276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:25.257893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:25.264183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:25.264617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:25.264750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ae7d2ff-f139-452a-bdce-eac1a616c363 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.196447 Nov 19 19:50:25.265238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1422/2793] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:25.265501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:25.265936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:25.413334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:25.422596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7104a926-a7d5-46dd-81f6-e7c1c43d58b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.168558 Nov 19 19:50:25.423334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1372/2794] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:25 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:26.282545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:26.283246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:26.289979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:26.290446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:26.291237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:26.291661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:26.427245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:26.438194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c9ad7964-bb21-4f6e-872b-82e44a3ba7d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.158693 Nov 19 19:50:26.438991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1423/2795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:26.451043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:26.452176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:26.461455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:26.461900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:26.462733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:26.463162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:26.612194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:26.620646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2afc22c9-b450-4002-8619-64f5ad9b3d08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.176987 Nov 19 19:50:26.621221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1373/2796] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:26 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:27.465297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:27.465886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:27.473277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:27.473755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:27.474570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:27.475006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:27.624330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:27.636947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5ac799e9-0eab-4927-9998-f1d33d743627 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175608 Nov 19 19:50:27.637532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1424/2797] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:27.640732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:27.641510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:27.648409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:27.648885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:27.649806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:27.650272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:27.790450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:27.799095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e86bc18e-79f4-41c5-859c-9ec42e8fca1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.162969 Nov 19 19:50:27.799666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1374/2798] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:27 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:28.655423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:28.656071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:28.664008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:28.664527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:28.665426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:28.665905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:28.803865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:28.814641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-324fbf28-7168-444e-8fd0-3b7bc509e8fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.162532 Nov 19 19:50:28.815263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1425/2799] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:28.819188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:28.819845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:28.829077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:28.829539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:28.830512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:28.830977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:28.978470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:28.987146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-17ad89aa-cbd7-4edb-a793-957252cc7d29 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.173468 Nov 19 19:50:28.987726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1375/2800] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:28 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:29.832787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:29.833487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:29.840544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:29.841073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:29.842261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:29.842691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:30.007148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:30.008161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:30.016217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:30.016567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:30.017304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:30.018446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:30.019082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:30.028808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-89a815c2-8830-4691-ac6d-ce8ea0fdb51d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.199387 Nov 19 19:50:30.030203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1426/2801] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:30.187039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:30.196451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d40104b9-5f87-46f6-89b4-843ec0acbcde tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.194420 Nov 19 19:50:30.197057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1376/2802] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:31.048129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:31.048825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:31.056321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:31.056771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:31.057581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:31.058011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:31.217788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:31.218979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:31.226514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:31.227244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:31.228513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:31.229078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:31.238544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:31.247377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a874c5b-75be-42a8-9db3-b6c8e9aa2dcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.203578 Nov 19 19:50:31.253637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1427/2803] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:31.380631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:31.389976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5046be5-a006-4cdf-8d2f-ef6f19b74b47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.178601 Nov 19 19:50:31.390913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1377/2804] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:32.265259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:32.266119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:32.273060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:32.273509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:32.274423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:32.274862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:32.410031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:32.410957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:32.418016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:32.418599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:32.419417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:32.419859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:32.429604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:32.439573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1fbe5a9-69fc-431e-b011-e5395a5fe16b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.178062 Nov 19 19:50:32.440168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1428/2805] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:32.572532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:32.581124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-37b4faae-ddde-4b97-b5e8-83f272025d75 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.175979 Nov 19 19:50:32.581715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1378/2806] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:32 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:33.458115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:33.458906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:33.466421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:33.467233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:33.467993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:33.468570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:33.605930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:33.606669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:33.615100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:33.615100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:33.615767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:33.616281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:33.617056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:33.625813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f924b3e0-8f43-438a-b9b2-6bd3f9aa3c37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.171464 Nov 19 19:50:33.626424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1429/2807] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:33.763076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:33.772335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-95d65148-8571-469b-a961-8a7f9a5c9dc2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.171518 Nov 19 19:50:33.772930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1379/2808] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:33 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:34.643088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:34.643697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:34.650470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:34.650938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:34.651715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:34.652115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:34.789548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:34.790198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:34.795571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:34.797290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:34.797754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:34.798931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:34.799402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:34.806753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35d40020-02a3-4405-916e-118c7a39e5b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.167525 Nov 19 19:50:34.807343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1430/2809] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:34.946735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:34.955322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-61247231-0fa2-48a0-8e19-3b05c9b48de6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.169487 Nov 19 19:50:34.955897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1380/2810] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:34 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:35.825163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:35.825815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:35.833187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:35.833628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:35.834453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:35.834882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:35.973712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:35.974967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:35.982917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:35.983449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:35.984563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:35.985323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:35.990521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:36.000789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-78b970d6-81f7-49f7-a560-6336fafe837f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.179258 Nov 19 19:50:36.001469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1431/2811] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:36.131312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:36.144312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8a013660-05fb-41c9-af7e-80517c3903cd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.174715 Nov 19 19:50:36.144930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1381/2812] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:35 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:36.621843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:50:36.622142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:50:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:50:37.019167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:37.019779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:37.026607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:37.027057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:37.027842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:37.028288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:37.173340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:37.173940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:37.180962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:37.181373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:37.182401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:37.182855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:37.194387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:37.202943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61f5eac3-a25c-40eb-9ec8-eebde7fa41e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.187360 Nov 19 19:50:37.203540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1432/2813] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:37.329028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:37.339013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8617430e-4fc0-49cd-821f-37003b0eea4a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.174689 Nov 19 19:50:37.339632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1382/2814] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:37 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:38.221252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:38.221884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:38.230728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:38.231278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:38.232082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:38.232506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:38.361967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:38.362649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:38.369203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:38.369644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:38.370450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:38.370882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:38.632662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:38.641326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8a51e76f-60b0-4eef-b7f4-f035c42a63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.423556 Nov 19 19:50:38.641910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1433/2815] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:38.724715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:38.737496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52edbb7c-f97d-44cd-a1d7-90619f287bbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.379175 Nov 19 19:50:38.738228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1383/2816] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:38 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:39.660399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:39.660995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:39.668754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:39.669206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:39.670343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:39.670534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:39.757947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:39.758576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:39.765151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:39.765725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:39.767146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:39.767341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:39.853324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:39.864520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ac5df415-fea3-4567-8b3b-ced88c82cb05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.208024 Nov 19 19:50:39.865491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1434/2817] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:39.931324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:39.943349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a2b354b2-2ae8-436b-b992-721d6bc4acf3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.189024 Nov 19 19:50:39.944327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1384/2818] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:39 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:40.882889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:40.883820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:40.891372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:40.891885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:40.892697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:40.893125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:40.961350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:40.962177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:40.970359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:40.970705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:40.971486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:40.976466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:41.075958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:41.084289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cf53fd80-8957-4936-adb5-c810436cf0cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.205319 Nov 19 19:50:41.084881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1435/2819] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:41.152825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:41.161619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-80cd3a6c-8553-41fb-8678-61b474c4435d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.204132 Nov 19 19:50:41.162241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1385/2820] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:40 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:42.102834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:42.103465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:42.110534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:42.110986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:42.111799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:42.112208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:42.178954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:42.179583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:42.185896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:42.186363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:42.187750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:42.188173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:42.282883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:42.291525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5819fcc-9bbe-4885-8e31-347f2741097b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.192262 Nov 19 19:50:42.292092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1436/2821] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:42.376586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:42.386859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a2a05da6-eb6d-4765-9747-5977c9d2f8eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.211456 Nov 19 19:50:42.387477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1386/2822] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:42 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:43.309642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:43.310394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:43.317706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:43.318154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:43.318965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:43.319397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:43.405050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:43.405671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:43.412410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:43.412865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:43.413657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:43.414114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:43.494978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:43.503770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a51c298b-9e98-4f0b-9b7b-61343a0d330c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.197785 Nov 19 19:50:43.504332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1437/2823] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:43.572470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:43.581268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e53f88d5-f289-4709-a3f0-7072143cf1d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179904 Nov 19 19:50:43.581856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1387/2824] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:43 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:44.521611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:44.522327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:44.529028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:44.529483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:44.530307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:44.530859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:44.599091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:44.599780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:44.606492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:44.606932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:44.607848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:44.608185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:44.704779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:44.717473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a59f1585-26ab-4bf9-8e22-fa0a3eaa0c04 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.198925 Nov 19 19:50:44.719284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1438/2825] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:44.789475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:44.798223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa0730f1-24ae-4977-a3db-752d9cee2688 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.202727 Nov 19 19:50:44.798885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1388/2826] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:44 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:45.743796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:45.744403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:45.752511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:45.752958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:45.753922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:45.754626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:45.815323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:45.815912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:45.822200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:45.822677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:45.823458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:45.823884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:45.923717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:45.931748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-385d3288-9b0e-4412-b995-7af58418a87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.192181 Nov 19 19:50:45.932316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1439/2827] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:45.988440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:45.996531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-29a35f62-9b84-4977-9fed-18aa406b5012 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.185248 Nov 19 19:50:45.997107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1389/2828] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:45 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:46.950324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:46.951029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:46.957775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:46.958267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:46.959042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:46.959471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:47.014016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:47.014660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:47.021552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:47.022039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:47.022869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:47.023301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:47.134191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:47.143695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8a8c5dc0-0b91-465f-bbef-eb1ded0f204d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.196998 Nov 19 19:50:47.146230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1440/2829] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:47.201179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:47.210713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e83d816f-00ba-44ac-9043-19e81671a4bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.200347 Nov 19 19:50:47.211301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1390/2830] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:47 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:48.164279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:48.164880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:48.172533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:48.172981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:48.174748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:48.175202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:48.234952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:48.235625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:48.243480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:48.243930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:48.244720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:48.245153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:48.377173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:48.387881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-041dc875-9405-4915-a7c0-296610075872 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227170 Nov 19 19:50:48.388655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1441/2831] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:48.430169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:48.439019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ebce7611-23a2-416e-80d9-6a5c153e7102 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.208179 Nov 19 19:50:48.439611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1391/2832] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:48 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:49.413605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:49.414213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:49.421368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:49.421811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:49.422675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:49.423260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:49.461193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:49.462271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:49.473727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:49.474510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:49.475896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:49.476587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:49.501816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:50:49.502285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:50:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 (ip 10.222.0.46) !!! Nov 19 19:50:49.602725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:49.611957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5b88439c-a6a6-41bc-9ebb-c8ea1df786b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.202044 Nov 19 19:50:49.612868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1442/2833] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:49.679815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:49.688753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f00755b0-301a-4165-8564-65db74066bef tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.234189 Nov 19 19:50:49.689363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1392/2834] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:49 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:50.636142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:50.636851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:50.643562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:50.644032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:50.644816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:50.645246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:50.706921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:50.707730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:50.719649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:50.720316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:50.721375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:50.721812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:50.821300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:50.830249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-16add37e-b707-4f15-8d7d-04d514c02633 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.197823 Nov 19 19:50:50.830857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1443/2835] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:50.896378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:50.904815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a4d5a288-3060-40e6-897b-317e77985cbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.201907 Nov 19 19:50:50.905396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1393/2836] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:50 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:51.849501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:51.850178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:51.856923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:51.857371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:51.858191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:51.858628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:51.922618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:51.923265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:51.930010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:51.930489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:51.931266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:51.931692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:52.027881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:52.036433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4011f524-4e26-401a-8d5d-3911e4f42b65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.190872 Nov 19 19:50:52.036941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1444/2837] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:52.103792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:52.112745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66bdd2dd-e288-4933-8c11-330902ebbd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.193853 Nov 19 19:50:52.113356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1394/2838] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:51 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:53.054905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:53.055502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:53.062271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:53.062715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:53.063485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:53.063912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:53.130169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:53.130782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:53.140226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:53.140936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:53.142395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:53.143203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:53.252304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:53.266030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e035b887-1537-495c-87fb-36f274fb6d97 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.214876 Nov 19 19:50:53.267272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1445/2839] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:53.330957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:53.341304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5f68aca-3f04-4549-9833-9e30fa478159 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.214673 Nov 19 19:50:53.342492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1395/2840] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:53 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:54.285074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:54.285658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:54.292405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:54.292852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:54.293615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:54.294038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:54.359744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:54.360421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:54.367336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:54.367865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:54.368631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:54.369059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:54.471967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:54.480156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79533ddc-5745-4c8d-93e6-af9fee86ba1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.198936 Nov 19 19:50:54.480765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1446/2841] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:54.548510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:54.557196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa76bdb1-4ccb-4d17-8f96-faf386cf2054 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.201251 Nov 19 19:50:54.557771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1396/2842] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:54 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:55.497892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:55.498495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:55.505289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:55.505742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:55.506572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:55.507001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:55.574502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:55.575145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:55.581865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:55.582371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:55.583198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:55.583633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:55.760268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:55.768502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8dc3b872-7fc4-4196-85fd-e5fbe1e30b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.274287 Nov 19 19:50:55.769077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1447/2843] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:55.785434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:55.793908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-691024f9-e561-4090-a381-6d8f40519c4b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.223293 Nov 19 19:50:55.794515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1397/2844] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:55 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:50:56.786152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:56.786810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:56.793454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:56.793904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:56.794714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:56.795144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:56.811900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:56.812568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:56.819566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:56.820163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:56.820938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:56.821351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:57.002007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:57.011501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e953d92e-adce-4e2a-b48d-87bff3a5bf33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.228961 Nov 19 19:50:57.019007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1448/2845] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:57.019431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:57.023922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1b552ea-ba69-4d88-9d01-0de91d28ef0a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.215835 Nov 19 19:50:57.024607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1398/2846] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:56 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:58.032593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:58.033232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:58.041190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:58.041730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:58.041848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:58.041953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:58.042712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:58.043141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:58.048341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:58.048811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:58.049563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:58.049988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:58.249430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:58.253307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:58.259022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b8aaa7ce-aa14-4967-9bda-4f3c29311575 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.232006 Nov 19 19:50:58.259853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1449/2847] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:58.262704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5aca0716-8f0c-4f26-a243-a7eca5b3496a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.225092 Nov 19 19:50:58.263312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1399/2848] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:58 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:59.277988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:59.278751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:59.282552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:50:59.283159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:50:59.285343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:59.285794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:59.286714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:59.287160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:59.290638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:59.291083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:59.291861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:50:59.292317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:50:59.490366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:59.494383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:50:59.499410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e4ef20a5-8c25-4d8c-bbaf-34991c9bd370 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.220421 Nov 19 19:50:59.499997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1400/2849] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:59 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:50:59.502886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-658005dd-245d-457a-a11f-1011b71c2bbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.228847 Nov 19 19:50:59.503594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1450/2850] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:50:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:00.022928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:51:00.023215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:51:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:51:00.518370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:00.519011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:00.520379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:00.521389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:00.526024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:00.526510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:00.527289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:00.527724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:00.527862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:00.528211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:00.528979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:00.529403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:00.730799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:00.734470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:00.739749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-32780d30-3ac2-41f4-bb4a-18ce3c6f1f5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.224781 Nov 19 19:51:00.740419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1401/2851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:00 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:00.747010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-edbdfddf-8897-45b7-ae27-a626ef4848af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.229830 Nov 19 19:51:00.748040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1451/2852] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:01.757912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:01.758589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:01.765510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:01.765990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:01.766813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:01.767244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:01.768571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:01.769159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:01.776857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:01.777329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:01.779618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:01.779618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:02.029208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:02.037698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f0cb8763-02bf-43fb-a5e0-d381854811f4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.283897 Nov 19 19:51:02.038337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1402/2853] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:01 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:02.043406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:02.054480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d245005e-92d0-4dbc-bcfc-297a9715b732 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.288687 Nov 19 19:51:02.055251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1452/2854] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:03.055865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:03.056732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:03.063096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:03.063545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:03.064321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:03.064764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:03.073816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:03.074675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:03.081604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:03.082078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:03.082911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:03.083468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:03.275516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:03.285006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e677f9f-3a74-45fb-9823-a430c392000d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.233392 Nov 19 19:51:03.286093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1403/2855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:03 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:03.288617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:03.297963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3680b517-32a0-4b91-bf0c-146b30eab318 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.229911 Nov 19 19:51:03.298836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1453/2856] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:03 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:04.302402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:04.303020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:04.310378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:04.310838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:04.311633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:04.312444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:04.317214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:04.317812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:04.324910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:04.325354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:04.326186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:04.326613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:04.524272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:04.528293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:04.533150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a33ee138-d304-4c55-b273-9635e3d84f7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.234407 Nov 19 19:51:04.533740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1404/2857] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:04 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:04.537526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-26d3f5c1-6b97-47bc-b7ba-7a5c68737ed1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223908 Nov 19 19:51:04.538203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1454/2858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:05.551204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:05.552075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:05.555760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:05.556615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:05.559102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:05.559692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:05.560389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:05.561127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:05.565277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:05.566011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:05.567942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:05.568496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:05.760516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:05.764867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:05.769099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04bc6f76-a24f-4791-b291-1301a39350c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.221717 Nov 19 19:51:05.769787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1405/2859] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:05 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:05.773606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-283b1fe4-79b2-403c-855d-fb29d51c2228 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.221424 Nov 19 19:51:05.774516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1455/2860] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:06.788889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:06.790781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:06.795800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:06.796572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:06.798640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:06.799114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:06.799881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:06.800310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:06.803748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:06.804302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:06.805694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:06.806254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:07.022205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:07.025897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:07.032541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a08c2ce1-cbf4-4192-a70b-d920052477b1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.249085 Nov 19 19:51:07.033119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1406/2861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:06 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:07.034506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1245c92f-0118-493a-b23d-626d43c17d95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.245611 Nov 19 19:51:07.035379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1456/2862] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:06 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:08.050261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:08.050974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:08.052958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:08.053561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:08.059154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:08.059603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:08.060389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:08.060591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:08.060823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:08.061043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:08.061807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:08.062277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:08.265213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:08.269873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:08.277453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5b0eeea6-cdcb-454f-8e0b-3049966521e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.228359 Nov 19 19:51:08.278036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1457/2863] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:08.279799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd7967d0-be29-4613-9eeb-c5bdcd21a572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.233615 Nov 19 19:51:08.280398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1407/2864] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:08 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:09.294725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:09.295521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:09.296571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:09.297274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:09.302297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:09.302781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:09.303724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:09.303868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:09.303989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:09.304275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:09.305088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:09.305666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:09.470169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:09.478711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-25e4c32d-d3ea-4e8c-a46d-f182892bed66 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.185662 Nov 19 19:51:09.479261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1408/2865] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:09 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:09.620350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:09.632843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b9a3d48c-2f73-491a-980e-ca69e7b8f6e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.341379 Nov 19 19:51:09.633559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1458/2866] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:10.497681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:10.498326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:10.505323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:10.505695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:10.506505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:10.506931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:10.654075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:10.654602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:10.654759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:10.661163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:10.661604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:10.662400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:10.662788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-491c0010-01c6-45d3-b1cb-f9a06b6a519d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.168819 Nov 19 19:51:10.663115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:10.663345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1409/2867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:10 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:10.798476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:10.807203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-01e18338-5d92-49ad-890c-deed2090d847 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.156786 Nov 19 19:51:10.807759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1459/2868] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:11.683143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:11.683790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:11.693149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:11.693692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:11.694698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:11.695277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:11.825260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:11.825919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:11.832355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:11.832784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:11.833759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:11.834201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:11.842902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:11.850796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-621caef2-e78d-4959-9eb3-2af3af8d244e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.174319 Nov 19 19:51:11.851370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1410/2869] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:11 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:11.968627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:11.976662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b3fc0a9d-77ab-44ad-a897-530d4117ffa4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.155728 Nov 19 19:51:11.977239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1460/2870] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:12.869908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:12.870724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:12.879362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:12.879920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:12.880892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:12.881424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:12.995151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:12.995730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:13.002638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:13.003083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:13.004033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:13.004491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:13.047052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:13.055503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2f1e28cf-af5d-44c1-90ac-08d31b60a34f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.190634 Nov 19 19:51:13.056125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1411/2871] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:12 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:13.146762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:13.156049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-31ffbefb-0e74-4f28-9e64-b6deeeb92977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.164539 Nov 19 19:51:13.156620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1461/2872] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:12 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:14.073773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:14.074453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:14.081180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:14.081629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:14.082437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:14.082867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:14.176801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:14.177373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:14.186929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:14.187488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:14.188618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:14.189068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:14.239560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:14.248852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3ae37dae-604a-42f6-9a9c-0dc08615e462 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.179497 Nov 19 19:51:14.249698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1412/2873] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:14 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:14.335088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:14.343374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-edb57980-2486-4630-8225-3aadccc62c10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.172082 Nov 19 19:51:14.343927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1462/2874] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:15.269934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:15.270536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:15.278801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:15.279244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:15.280042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:15.280480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:15.361647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:15.362520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:15.372145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:15.372686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:15.373663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:15.373929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:15.460267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:15.473286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e9ee82f-4d72-4cd2-80e5-559c0491571b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.208199 Nov 19 19:51:15.473939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1413/2875] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:15 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:15.539637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:15.547867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-779590d9-e205-43e3-bca0-b943931db8fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.190065 Nov 19 19:51:15.548680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1463/2876] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:16.497075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:16.497696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:16.504860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:16.505241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:16.506013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:16.506475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:16.568267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:16.568968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:16.579646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:16.580255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:16.581414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:16.581911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:16.698213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:16.706362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9750e267-0c82-43d9-98d8-c80a92526b7c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.214535 Nov 19 19:51:16.706961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1414/2877] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:16.762765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:16.775232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8196dc24-56c0-4f7f-a522-6f2292bd325f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.212741 Nov 19 19:51:16.776073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1464/2878] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:17.728134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:17.729132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:17.736786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:17.737214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:17.737985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:17.738449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:17.797136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:17.797758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:17.804641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:17.805085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:17.805866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:17.806327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:17.907921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:17.916919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0414f762-7612-4461-9669-897375d7644f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.194745 Nov 19 19:51:17.917485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1415/2879] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:17 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:17.970543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:17.982210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95e3fe56-cf4d-4685-a491-962217707d65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.189252 Nov 19 19:51:17.982794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1465/2880] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:17 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:18.934841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:18.935477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:18.941981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:18.942468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:18.943242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:18.943675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:18.999878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:19.000616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:19.007657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:19.008478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:19.009890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:19.010786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:19.111012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:19.119156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8bb1c769-6994-45d8-a1aa-f9976c86680e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.188178 Nov 19 19:51:19.119710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1416/2881] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:18 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:19.177601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:19.185784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f74350fb-0f7b-4800-9411-559227fc406d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.189744 Nov 19 19:51:19.186330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1466/2882] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:20.136188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:20.136821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:20.145005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:20.145449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:20.146272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:20.146707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:20.204517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:20.205253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:20.212385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:20.212894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:20.213689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:20.214147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:20.320858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:20.330254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b2c434d-38da-4041-a13c-dbeedf06fb13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.197631 Nov 19 19:51:20.331043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1417/2883] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:20 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:20.397468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:20.406150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35458e56-a3d2-4ed3-9e16-f663c205770d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.206571 Nov 19 19:51:20.406691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1467/2884] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:21.352921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:21.353706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:21.360868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:21.361607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:21.363059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:21.363800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:21.426527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:21.427261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:21.434288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:21.434956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:21.435935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:21.436564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:21.543903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:21.553279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-acdf7025-ae61-4875-8498-b7e2dd4bea1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.204360 Nov 19 19:51:21.553899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1418/2885] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:21 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:21.609994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:21.618135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8898daf-9e45-40e4-8364-f849f465c4ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.197316 Nov 19 19:51:21.618705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1468/2886] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:22.570748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:22.571328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:22.578167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:22.578613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:22.579405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:22.579854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:22.636750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:22.637350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:22.644938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:22.645506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:22.646366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:22.646872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:22.738985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:22.747230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76465ee3-a761-406a-af44-980c707d1661 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.180241 Nov 19 19:51:22.747801 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1419/2887] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:22 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:22.808810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:22.821441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-433b049f-0bc1-4985-9347-ea255aca08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.188915 Nov 19 19:51:22.822201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1469/2888] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:23.764890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:23.765488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:23.773495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:23.773944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:23.774824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:23.775448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:23.839729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:23.840674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:23.847736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:23.848184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:23.848959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:23.849384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:23.939894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:23.948140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6eb54f43-e215-4d1e-9b74-65a015c29095 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.186963 Nov 19 19:51:23.948735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1420/2889] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:23 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:24.004144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:24.012444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-076c8c08-39aa-4958-943e-55c84c0415e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.176763 Nov 19 19:51:24.013017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1470/2890] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:24.965500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:24.966688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:24.973313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:24.973764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:24.974598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:24.975033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:25.036963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:25.038161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:25.049575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:25.050196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:25.051102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:25.051637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:25.145307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:25.153603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02d75c03-1333-4262-8b42-209481221142 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.191782 Nov 19 19:51:25.154289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1421/2891] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:25.216885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:25.231913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-419bd427-5fce-4c0f-85ad-71fb4b292828 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.200845 Nov 19 19:51:25.232818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1471/2892] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:26.174483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:26.175594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:26.184421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:26.184871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:26.185659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:26.186329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:26.252152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:26.252827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:26.259884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:26.260354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:26.261116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:26.261549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:26.363868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:26.371848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-066ba4d4-ba43-48ed-9bfc-238b236624d4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.203953 Nov 19 19:51:26.372429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1422/2893] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:26 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:26.427193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:26.445284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-857931c8-2402-45c6-9984-c5b86eba86e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.197163 Nov 19 19:51:26.446295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1472/2894] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:27.389806 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:27.390402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:27.398089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:27.398572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:27.399356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:27.399789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:27.468494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:27.469263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:27.476821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:27.477447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:27.478280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:27.478720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:27.832068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:27.840272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-165c0ed0-2724-4511-b826-85696570b086 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.454260 Nov 19 19:51:27.840866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1423/2895] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:27 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:27.902664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:27.911732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-878b1657-6357-4406-9a41-2204b44cd911 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.447374 Nov 19 19:51:27.912310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1473/2896] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:28.859837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:28.860543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:28.867428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:28.867880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:28.868733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:28.869093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:28.929595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:28.930542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:28.938110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:28.938611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:28.939406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:28.939836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:29.045900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:29.058120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5c39f946-e7d9-4c51-a810-b1ec7d0488cb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.202411 Nov 19 19:51:29.058907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1424/2897] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:28 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:29.120561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:29.128839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b78132eb-9071-43d2-b4d1-1cb2e077ccde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.203337 Nov 19 19:51:29.129398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1474/2898] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:30.076827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:30.077463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:30.084489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:30.084936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:30.085723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:30.086192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:30.146590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:30.147203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:30.153827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:30.154293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:30.155066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:30.155486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:30.255631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:30.263742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ca9b56cb-ef8b-4ef0-b3b2-4ae1f284ce77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.190607 Nov 19 19:51:30.264320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1425/2899] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:30.320636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:30.330250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e105efe8-a224-4343-bc83-b0bcbd703ab2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.187297 Nov 19 19:51:30.330749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1475/2900] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:31.281996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:31.282601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:31.289768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:31.290252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:31.291052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:31.291484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:31.348364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:31.349011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:31.355672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:31.356123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:31.356903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:31.357330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:31.458874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:31.467222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7c19638-9f55-4d3f-bef3-503bff534031 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.188917 Nov 19 19:51:31.467792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1426/2901] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:31.533442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:31.542504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-caa80fa1-86d8-4d0d-9933-c92383ffbe46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.197865 Nov 19 19:51:31.543081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1476/2902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:32.485608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:32.486259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:32.493174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:32.493651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:32.494557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:32.494981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:32.560471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:32.561045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:32.567614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:32.568037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:32.568817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:32.569242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:32.674083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:32.682977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f5ba3ac8-59cf-42fb-8449-d635fea5bea9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.201156 Nov 19 19:51:32.683465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1427/2903] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:32 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:32.737890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:32.746367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f09b021-9213-45d5-bda2-dfa91fed2ee6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.189677 Nov 19 19:51:32.746956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1477/2904] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:33.700551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:33.701202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:33.708004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:33.708453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:33.709222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:33.709653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:33.766954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:33.767567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:33.777813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:33.779031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:33.780185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:33.780933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:33.891561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:33.899985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6e9180da-521f-423a-a991-ce6bb526b1c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.203167 Nov 19 19:51:33.900552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1428/2905] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:33 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:33.951750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:33.960448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-03e5db08-112c-44db-b410-7a88c9b72baf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.198860 Nov 19 19:51:33.961037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1478/2906] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:34.917389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:34.918232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:34.925106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:34.925555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:34.927132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:34.927567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:34.979342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:34.980056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:34.987148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:34.987596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:34.988593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:34.989024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:35.104902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:35.113770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e4ccf41-f42d-4b4e-8ad5-0d390400eae2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.199814 Nov 19 19:51:35.116014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1429/2907] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:34 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:35.173607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:35.182685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aad92777-5021-4398-aabe-f9b26a06e1e1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.207666 Nov 19 19:51:35.183276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1479/2908] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:36.132091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:36.132759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:36.139668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:36.140116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:36.140907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:36.141341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:36.200756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:36.201392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:36.208337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:36.208790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:36.209809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:36.210267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:36.320814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:36.331604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ff129c8-7d23-4358-bb18-d5d0a8f0fcfc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.203646 Nov 19 19:51:36.334318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1430/2909] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:36 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:36.409072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:36.419137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-35bc5715-56b1-4468-9dc4-1d6dab69e96e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.222101 Nov 19 19:51:36.419820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1480/2910] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:37.349858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:37.350707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:37.357655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:37.358230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:37.359054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:37.359745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:37.439485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:37.440036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:37.447225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:37.447650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:37.448429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:37.448860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:37.503470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:37.511944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ce65f57e-3d65-4650-bffe-81aaaf415574 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.165992 Nov 19 19:51:37.512616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1431/2911] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:37 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:37.592944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:37.604420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c36a44e2-3525-4b19-ae78-722658383924 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.168798 Nov 19 19:51:37.605237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1481/2912] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:38.531481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:38.532062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:38.541225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:38.541738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:38.542816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:38.543384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:38.624925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:38.625554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:38.632331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:38.632764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:38.633536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:38.633968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:38.689044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:38.698228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23dc38a8-0ba3-4e9a-9791-16aad29c3945 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.171849 Nov 19 19:51:38.698803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1432/2913] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:38 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:38.781617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:38.789897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba15416c-2ff0-4361-b9cb-886e58a25d09 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.168688 Nov 19 19:51:38.790502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1482/2914] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:39.715720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:39.716720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:39.723866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:39.724311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:39.725078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:39.725504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:39.807747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:39.808362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:39.815058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:39.816322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:39.817396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:39.817828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:39.902764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:39.910561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3a5b44d6-3a20-4593-9e92-680cebaf6a62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.198549 Nov 19 19:51:39.911135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1433/2915] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:39 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:39.987056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:39.996037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ab4df31-d234-4435-b956-3af4b1aaecd2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.191887 Nov 19 19:51:39.996635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1483/2916] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:40.929146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:40.929773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:40.936578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:40.937033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:40.937818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:40.938295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:41.013881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:41.014535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:41.021281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:41.021734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:41.022545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:41.022979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:41.134622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:41.142788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b74a3bc-26e6-4cf1-8962-9e5d1dfdcb5b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.217661 Nov 19 19:51:41.148491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1434/2917] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:40 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:41.200580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:41.210637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dcd8279f-019b-4836-9507-f62412905f22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.200454 Nov 19 19:51:41.211271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1484/2918] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:42.164135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:42.164744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:42.171803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:42.172257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:42.173035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:42.173472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:42.228648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:42.229257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:42.236206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:42.236650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:42.237441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:42.237864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:42.342587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:42.350788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-44c4763e-d4e3-48ed-8a55-140d22880785 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.190556 Nov 19 19:51:42.351391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1435/2919] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:42 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:42.406393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:42.420542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d1a107b-dde1-4f9a-9bc1-25dba744ce0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.195195 Nov 19 19:51:42.421376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1485/2920] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:43.368331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:43.369011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:43.375713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:43.376163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:43.376974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:43.377407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:43.441029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:43.441612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:43.448701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:43.449090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:43.449893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:43.450319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:43.554773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:43.562976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ce87001d-fd19-468a-8d27-03235a4d3eb3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.198306 Nov 19 19:51:43.563546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1436/2921] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:43 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:43.629920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:43.641872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2649db1f-385e-447d-a84b-598c19d15bee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.204326 Nov 19 19:51:43.642680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1486/2922] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:44.581298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:44.581871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:44.588894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:44.589367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:44.590185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:44.590615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:44.659732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:44.660377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:44.666784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:44.667232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:44.668006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:44.668434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:44.757354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:44.766401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1bab8529-3de6-459c-b5d4-d8b8e99f9659 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.188993 Nov 19 19:51:44.766957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1437/2923] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:44 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:44.823756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:44.832191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2b95a725-44c8-4061-b962-ce14c6f2f0c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.176074 Nov 19 19:51:44.832685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1487/2924] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:45.785740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:45.786382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:45.793882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:45.794138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:45.794925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:45.795360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:45.849552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:45.850638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:45.857492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:45.857934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:45.858760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:45.859186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:45.967946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:45.983602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7abc1b48-46dc-4a7b-935d-f7861380813e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.196253 Nov 19 19:51:45.986201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1438/2925] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:45 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:46.036192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:46.045028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4fba2ef8-a12f-4425-8487-8f5f661b1822 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.199030 Nov 19 19:51:46.045910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1488/2926] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:46.995715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:46.996613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:47.005364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:47.005879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:47.006746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:47.007334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:47.064071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:47.064997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:47.072852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:47.073400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:47.074685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:47.075153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:47.195468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:47.211474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9cdff677-0ff2-4c8c-9da2-c313b8bccde7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.220615 Nov 19 19:51:47.212717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1439/2927] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:46 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:47.272805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:47.282794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f3e457c8-6062-49f5-b011-fc0ac06e2c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.222612 Nov 19 19:51:47.283383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1489/2928] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:47 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:48.234391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:48.235088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:48.243110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:48.243557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:48.244323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:48.244754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:48.302814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:48.303480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:48.310743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:48.311411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:48.312431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:48.312718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:48.426391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:48.437271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5ca4b79-31fb-4607-9036-f3e5c72db729 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.209008 Nov 19 19:51:48.439514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1440/2929] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:48 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:48.498180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:48.509066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-73ea4def-6aba-40a0-9568-17198c255eec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.209919 Nov 19 19:51:48.509952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1490/2930] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:49.457640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:49.458245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:49.468598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:49.469311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:49.470517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:49.471033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:49.529805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:49.530440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:49.536995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:49.537446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:49.538257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:49.538694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:49.658679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:49.667257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ff3a449b-69d7-4140-9803-45a57c19ba2f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.214326 Nov 19 19:51:49.668031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1441/2931] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:49 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:49.703945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:49.712637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d246a9a-2e38-480d-a6b6-f39fec0ab635 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.187604 Nov 19 19:51:49.713135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1491/2932] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:50.687721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:50.688368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:50.697428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:50.698027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:50.699126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:50.699727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:50.730519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:50.731386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:50.738124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:50.738572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:50.739426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:50.739767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:50.873128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:50.881626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96a34859-105e-4649-9fb8-f62ad99aa9fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.199421 Nov 19 19:51:50.882243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1442/2933] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:50 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:50.923085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:50.934809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d4b22088-0992-4761-bd37-9dffdbe969b6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.207585 Nov 19 19:51:50.935262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1492/2934] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:51.900032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:51.900669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:51.907499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:51.907944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:51.908709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:51.909134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:51.951841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:51.952460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:51.959043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:51.959494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:51.960271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:51.960700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:52.090507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:52.098983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6ad6629d-ab6d-4749-8dbd-ff0be4709c0d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.202674 Nov 19 19:51:52.099573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1443/2935] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:51 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:52.139011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:52.147868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4316bdc1-a364-40e2-a23d-366f6e97b821 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.199779 Nov 19 19:51:52.148421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1493/2936] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:51:53.116444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:53.117081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:53.124318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:53.124764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:53.125535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:53.125967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:53.165953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:53.166601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:53.173642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:53.174088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:53.174898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:53.175329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:53.300746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:53.309564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9a8d1f84-d86a-49f9-b171-bcd989b135e6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.196323 Nov 19 19:51:53.310106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1444/2937] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:53 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:53.347631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:53.356188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-818f5266-6582-480c-b78c-92722af3c455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.193877 Nov 19 19:51:53.356869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1494/2938] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:54.328236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:54.328841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:54.335726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:54.336170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:54.336912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:54.337370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:54.373668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:54.374497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:54.381154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:54.381433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:54.382242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:54.382659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:54.534429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:54.543037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-380b8727-d166-4bc0-9861-99e0e830754e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.219372 Nov 19 19:51:54.543625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1445/2939] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:54 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:54.562971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:54.571108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a805357b-78c2-425f-a589-e8925860daa9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.201011 Nov 19 19:51:54.571680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1495/2940] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:55.564553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:55.565304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:55.572375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:55.572827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:55.573601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:55.574031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:55.588447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:55.589118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:55.596599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:55.597008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:55.598028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:55.598514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:55.762740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:55.772290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-650e1bea-d84e-4294-a26e-80f934bb3d26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.213853 Nov 19 19:51:55.772838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1446/2941] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:55 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:55.799830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:55.808581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-415398dc-2270-4334-8c4a-ea88d6ffde1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223631 Nov 19 19:51:55.809154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1496/2942] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:56.791003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:56.791558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:56.800464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:56.801089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:56.802378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:56.802946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:56.826461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:56.827046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:56.834293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:56.834744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:56.835517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:56.835944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:57.025716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:57.030255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:57.033890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-385adf29-0280-476d-aa79-b34f0d9bdce6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.248049 Nov 19 19:51:57.034498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1447/2943] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:56 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:57.038825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1b23642-b4df-48f4-8335-de11f58fdb2f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.215951 Nov 19 19:51:57.039557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1497/2944] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:58.058863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:58.060139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:58.061375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:58.061995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:58.066811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:58.067234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:58.068015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:58.068441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:58.069029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:58.069486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:58.070297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:58.070730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:58.280364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:58.283922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:58.289668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad63effa-77a5-4af5-ad6f-69c6ad08cd93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.233146 Nov 19 19:51:58.290268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1498/2945] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:58 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:58.291935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ed996ac3-5c14-40e3-9ff8-95b678cb7096 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.236717 Nov 19 19:51:58.292482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1448/2946] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:59.307483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:59.308108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:59.309206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:51:59.309962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:51:59.315284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:59.315850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:59.316672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:59.316916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:59.317098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:59.317369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:59.318181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:51:59.318613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:51:59.516518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:59.520576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:51:59.524931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b4e44a6-ec0b-4ffb-be0b-af68468de3a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.219322 Nov 19 19:51:59.525506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1449/2947] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:51:59.528834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5b32df1f-aaa5-4817-b819-6f483e7952f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.225089 Nov 19 19:51:59.529381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1499/2948] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:51:59 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:00.542757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:00.543429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:00.546691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:00.547302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:00.550606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:00.551058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:00.551847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:00.552284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:00.554081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:00.554531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:00.555335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:00.555764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:00.753194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:00.757519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:00.762365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1823fd4-89c3-4e5d-ba12-49e090f95c98 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223302 Nov 19 19:52:00.765671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-737fe3e0-3b78-4a2e-aeec-82132624b82c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.222550 Nov 19 19:52:00.770779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1500/2949] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:00 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:00.771512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1450/2950] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:01.779532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:01.780120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:01.782779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:01.783437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:01.787898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:01.788432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:01.789153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:01.789572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:01.789975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:01.790447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:01.791221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:01.791646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:01.994691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:02.002958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-81ba25ec-76fb-4202-99e1-c3a9dca76e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227121 Nov 19 19:52:02.003541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1501/2951] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:02.008638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:02.016712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8ab03cd-54a6-4293-b800-7b206ad9d961 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.237429 Nov 19 19:52:02.017226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1451/2952] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:01 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:03.020461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:03.021069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:03.027548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:03.028248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:03.029017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:03.029440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:03.032872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:03.033655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:03.041847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:03.042946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:03.043747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:03.044181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:03.226393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:03.234832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19a8d776-24f8-40d9-b2af-e1a92ae45548 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.218150 Nov 19 19:52:03.235375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1502/2953] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:03 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:03.238825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:03.247099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e1eddd9-ad4b-4534-ba8c-fed254054d22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.217844 Nov 19 19:52:03.247701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1452/2954] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:03 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:04.251900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:04.253143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:04.259550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:04.259991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:04.260850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:04.261279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:04.265891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:04.266539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:04.273249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:04.273694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:04.274506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:04.274963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:04.461219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:04.464119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:04.469623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-87ecf8bd-5129-4971-9c88-f24b09781f45 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.221394 Nov 19 19:52:04.470331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1503/2955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:04.472432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-051e6689-05c6-4ae6-aff3-e3a1ecad7194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.210193 Nov 19 19:52:04.472997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1453/2956] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:04 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:05.488616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:05.489262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:05.491274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:05.491883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:05.495908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:05.496349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:05.497116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:05.497544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:05.498517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:05.498963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:05.499732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:05.500160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:05.708523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:05.712695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:05.717399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f1dcfa08-f5d9-439c-acc4-104b43423bb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.232790 Nov 19 19:52:05.717999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1504/2957] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:05.721702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bdba74dc-533b-4dd5-b916-c87af19e4a13 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.233726 Nov 19 19:52:05.722283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1454/2958] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:05 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:06.735438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:06.736209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:06.739297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:06.740224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:06.744891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:06.745569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:06.746929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:06.747881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:06.749037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:06.749645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:06.750881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:06.751427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:06.951453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:06.956807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:06.960379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e44307f1-c89b-4cf8-ae32-75deb49c40d7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.228688 Nov 19 19:52:06.960955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1505/2959] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:06 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:06.964939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fcc23775-6448-4a1e-a00a-9fab038f5834 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.229584 Nov 19 19:52:06.965523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1455/2960] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:06 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:07.980433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:07.981075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:07.983312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:07.984047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:07.992652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:07.993112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:07.993379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:07.993828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:07.993943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:07.994313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:07.996426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:07.996912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:08.220280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:08.231255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:08.234842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1e42627-e831-40cc-a629-a8914be90456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.258843 Nov 19 19:52:08.235823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1506/2961] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:08.239882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5a64623d-3ad2-491e-9e99-defa007ea047 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.260234 Nov 19 19:52:08.240441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1456/2962] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:07 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:09.256258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:09.257097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:09.260959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:09.261784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:09.264153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:09.264602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:09.266550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:09.266550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:09.269223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:09.269912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:09.271533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:09.272022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:09.506820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:09.515662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:09.517903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7ce917a5-2d5d-48dc-b6a4-4ce2278d66c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.263514 Nov 19 19:52:09.519307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1457/2963] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:09 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:09.524841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52ec1789-5cb4-4097-940d-e371b62ba4fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.273507 Nov 19 19:52:09.525425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1507/2964] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:10.536594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:10.537211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:10.544105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:10.544556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:10.545339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:10.545838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:10.682482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:10.683268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:10.688881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:10.689775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:10.690358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:10.691211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:10.691735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:10.697344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-72de9e2f-7138-4b41-a0e2-f774a285f7fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.164592 Nov 19 19:52:10.698020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1458/2965] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:10 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:10.838750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:10.849241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3a252da5-983b-4302-9625-2d4ff082f6f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.301987 Nov 19 19:52:10.849821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1508/2966] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:11.715404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:11.716344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:11.723506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:11.724095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:11.724877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:11.725312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:11.863153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:11.867294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:11.867893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:11.871469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eae5da7d-ea31-4d9f-9c5f-032813f0f194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.159890 Nov 19 19:52:11.872162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1459/2967] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:11 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:11.874281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:11.874724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:11.875487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:11.875873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:12.016645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:12.026085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-255a66cc-2300-4b8e-9a03-59cfe754e93e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.162368 Nov 19 19:52:12.026719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1509/2968] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:12.889843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:12.890570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:12.898327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:12.898771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:12.899578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:12.900143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:13.044431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:13.045026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:13.051836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:13.052301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:13.053076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:13.053505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:13.061331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:13.069957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-acf12876-35f2-4279-ae32-a13c3d8fde58 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.184124 Nov 19 19:52:13.070990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1460/2969] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:12 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:13.094556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:52:13.094841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:52:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:52:13.195772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:13.203959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-534125c8-63a9-4797-b4a7-142d59f5c67d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.163212 Nov 19 19:52:13.204529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1510/2970] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:14.088421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:14.089192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:14.096407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:14.096847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:14.097804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:14.098414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:14.221089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:14.221766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:14.229486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:14.229933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:14.230725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:14.231150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:14.493717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:14.502337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bf308dd2-c0c2-4ccc-9693-a4e22e024b83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.417555 Nov 19 19:52:14.503279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1461/2971] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:14 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:14.587923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:14.596429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79927856-22d2-4fa4-a24c-188b70564c0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.379113 Nov 19 19:52:14.596990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1511/2972] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:15.522387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:15.524324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:15.536655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:15.537096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:15.537925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:15.538383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:15.614083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:15.614675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:15.621966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:15.622479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:15.623230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:15.623702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:15.723888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:15.732051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e9cc724f-b17c-416b-9cec-583856e32acb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.215090 Nov 19 19:52:15.732618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1462/2973] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:15 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:15.792593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:15.800578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4a88258d-f4d9-44c4-8d37-827cba48fd15 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.190369 Nov 19 19:52:15.801308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1512/2974] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:16.750317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:16.750912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:16.757960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:16.758325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:16.759117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:16.759534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:16.818835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:16.819449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:16.826979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:16.827298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:16.828111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:16.829430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:16.944088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:16.952207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3ab9d4ce-1f7d-4985-9c07-b2bf40c1b0ba tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.205656 Nov 19 19:52:16.952808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1463/2975] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:17.027829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:17.036566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c22cc2c3-eeeb-4bcb-8d41-9acc453b128d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.221778 Nov 19 19:52:17.037163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1513/2976] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:17.985686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:17.986469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:17.994474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:17.994925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:17.995721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:17.996149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:18.054524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:18.055097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:18.062851 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:18.063324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:18.064119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:18.064548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:18.167285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:18.176425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f3a3443-edfc-4ed8-8c36-0047beb9af6c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.194370 Nov 19 19:52:18.177023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1464/2977] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:17 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:18.244139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:18.252895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6bb2321-b6dd-47e4-a6d5-c80a55b35b6b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.202182 Nov 19 19:52:18.254149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1514/2978] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:19.194778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:19.195433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:19.202545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:19.202765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:19.203615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:19.203896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:19.270832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:19.271537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:19.278521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:19.278945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:19.279763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:19.280193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:19.391913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:19.400785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3ad4428b-954d-47f3-8f63-eef8bef60291 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.209727 Nov 19 19:52:19.401372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1465/2979] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:19 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:19.461810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:19.470880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9abb74a9-5bc5-4c79-b0b7-a519d147b517 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.203739 Nov 19 19:52:19.471462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1515/2980] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:20.418999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:20.419651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:20.426964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:20.427408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:20.428201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:20.428632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:20.492865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:20.494010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:20.505862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:20.506593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:20.508042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:20.508794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:20.655195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:20.670025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2deb539d-d731-48b9-b6e0-cde5138c98e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.254363 Nov 19 19:52:20.671081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1466/2981] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:20 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:20.721344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:20.734932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-84bfe60e-b252-4f16-b22a-f93f4cad58f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.249063 Nov 19 19:52:20.735833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1516/2982] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:21.690107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:21.690804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:21.697607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:21.698073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:21.698868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:21.699294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:21.754005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:21.754005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:21.762415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:21.762415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:21.764454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:21.764454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:21.886097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:21.898722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0303abf1-9442-4df4-90d3-eb4988e8360e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.212226 Nov 19 19:52:21.899565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1467/2983] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:21 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:21.969957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:21.979778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-caf01911-9969-45e4-a8d2-391a8ae5e4bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.230399 Nov 19 19:52:21.980382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1517/2984] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:22.924048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:22.924647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:22.931823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:22.932297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:22.933094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:22.933522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:22.999698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:23.001040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:23.008903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:23.009583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:23.010654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:23.011244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:23.163555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:23.177038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48d21932-4be2-4564-a4ee-0eae278235fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.256488 Nov 19 19:52:23.177925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1468/2985] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:22 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:23.215306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:23.224407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79ff8467-c64f-4256-9be9-21b953533516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.230242 Nov 19 19:52:23.225009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1518/2986] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:24.195646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:24.196304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:24.203436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:24.203914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:24.204761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:24.205274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:24.242113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:24.242937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:24.249898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:24.250384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:24.251238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:24.251681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:24.415573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:24.424074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b49a684-90cd-4dbf-8d3b-1cdbf8462549 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.232222 Nov 19 19:52:24.424663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1469/2987] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:24.456284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:24.465814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bcce4041-5426-4409-9d4e-2f4f05c5e4e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227485 Nov 19 19:52:24.466810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1519/2988] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:25.442632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:25.443248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:25.449927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:25.450387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:25.451320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:25.451816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:25.485105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:25.492027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:25.492521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:25.492965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:25.493754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:25.494254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:25.647713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:25.656135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2140106-e2f5-450b-8ea3-ce0ce7bbe958 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.217204 Nov 19 19:52:25.656741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1470/2989] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:25 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:25.695867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:25.705130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1c58c430-6fba-4825-9af1-dc4e5859050c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223490 Nov 19 19:52:25.705599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1520/2990] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:26.680609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:26.681170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:26.688304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:26.688764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:26.689543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:26.689974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:26.723089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:26.723752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:26.730878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:26.731308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:26.732322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:26.732751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:26.860347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:26.872378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa734912-70ec-49ca-b0f2-ed68a40138dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.195840 Nov 19 19:52:26.873351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1471/2991] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:26 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:26.949230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:26.957752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e04c2034-fbcb-4589-8d45-49d521fac631 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.238185 Nov 19 19:52:26.958497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1521/2992] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:27.893396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:27.894095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:27.901433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:27.901900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:27.902731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:27.903165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:27.977312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:27.978239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:27.984328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:27.984774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:27.985567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:27.986002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:28.093115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:28.102968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-62fbdb10-71c8-43f3-8d72-11eec04b4c67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.213353 Nov 19 19:52:28.103546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1472/2993] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:27 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:28.152359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:28.162973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc9a50ee-906d-43e5-987a-acf96ee21586 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.190229 Nov 19 19:52:28.163606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1522/2994] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:27 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:29.120688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:29.121279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:29.128152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:29.128592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:29.129376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:29.129787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:29.180993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:29.181809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:29.190898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:29.191595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:29.192370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:29.192805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:29.313180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:29.321910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-38a97a35-c884-446d-9b63-de293395f5fe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.204900 Nov 19 19:52:29.322531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1473/2995] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:29 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:29.383150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:29.394394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c2a52f5-401d-458e-abfa-53bf22284415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.217113 Nov 19 19:52:29.395235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1523/2996] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:29.777563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:52:29.777853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:52:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:52:30.339366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:30.340063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:30.347892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:30.348368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:30.349912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:30.350385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:30.411765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:30.412485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:30.419002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:30.419452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:30.420232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:30.420655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:30.523246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:30.536231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8de8771b-56d4-4509-ad35-08002a440912 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.200789 Nov 19 19:52:30.537154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1474/2997] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:30.593167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:30.604868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dea55504-3e4e-4b95-97a0-9be9e88cb36a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.196624 Nov 19 19:52:30.605661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1524/2998] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:31.552692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:31.553327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:31.561723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:31.562194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:31.562982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:31.563402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:31.622818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:31.623694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:31.631378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:31.631746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:31.632546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:31.632978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:31.734889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:31.742802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6f0e497-4f7e-4969-9d9d-0914d95018b2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.193770 Nov 19 19:52:31.743374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1475/2999] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:31.798074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:31.810976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-651e5b58-cf25-4d9d-9cf7-bfebfda969a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.191736 Nov 19 19:52:31.811788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1525/3000] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:32.760263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:32.760892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:32.767126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:32.767565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:32.768339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:32.768766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:32.829061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:32.829708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:32.836674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:32.837124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:32.837935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:32.838493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:32.930403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:32.942034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0093fad6-d76d-4975-9582-11cbb44345d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.185705 Nov 19 19:52:32.942635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1476/3001] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:32 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:33.005327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:33.014500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f9faf651-1d73-4b42-8fac-5bd94ae0c520 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.189028 Nov 19 19:52:33.014993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1526/3002] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:33.965227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:33.966207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:33.974939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:33.975522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:33.976958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:33.977393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:34.036258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:34.036876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:34.043780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:34.044221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:34.044982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:34.045615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:34.139601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:34.147694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a5e37ff3-3cc7-4a15-99aa-2f4c872179db tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.187524 Nov 19 19:52:34.148353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1477/3003] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:33 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:34.210384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:34.219808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ece17bd8-ad9a-4cb6-877e-1ba778deabbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.187114 Nov 19 19:52:34.220314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1527/3004] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:35.164992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:35.165795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:35.172426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:35.172880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:35.173672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:35.174715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:35.236656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:35.237284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:35.244302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:35.244796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:35.245584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:35.246014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:35.349078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:35.357666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f286bdef-c6fa-4b32-b6b1-92c7bf3cf68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.196298 Nov 19 19:52:35.358243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1478/3005] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:35 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:35.416436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:35.424457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9588b240-d234-4ec7-b66f-3c616cf87fba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.191453 Nov 19 19:52:35.425027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1528/3006] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:36.375064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:36.375698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:36.383693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:36.384487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:36.385813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:36.386548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:36.442287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:36.442985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:36.450953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:36.451852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:36.452291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:36.452908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:36.576685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:36.586271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ff504c3f-1ec4-4a4c-8623-dc5705d9e0c3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.214805 Nov 19 19:52:36.589080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1479/3007] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:36 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:36.632850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:36.641089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7101a0cf-d0d1-4853-b73d-b2df29104c22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.202489 Nov 19 19:52:36.641671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1529/3008] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:37.607122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:37.607597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:37.614355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:37.614962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:37.615791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:37.616464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:37.672738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:37.673509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:37.681711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:37.682370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:37.683176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:37.683621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:37.827591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:37.837622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e27bfad4-1183-4c17-adc2-ddd04c1a1d34 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.235620 Nov 19 19:52:37.838458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1480/3009] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:37 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:37.907739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:37.916273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd86721d-c43b-4e6d-abf6-d13346b64e32 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.260024 Nov 19 19:52:37.916867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1530/3010] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:38.855601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:38.856404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:38.863106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:38.863553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:38.864345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:38.864778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:38.945843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:38.947478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:38.958478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:38.959355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:38.960918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:38.961806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:39.056272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:39.064783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a97f920f-28d3-4b74-b522-177900c19658 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.213430 Nov 19 19:52:39.065384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1481/3011] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:38 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:39.154679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:39.164029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d59eafaf-b9a5-4d67-bb67-71184539a6d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.225442 Nov 19 19:52:39.164668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1531/3012] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:40.084455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:40.085476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:40.093254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:40.093699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:40.094530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:40.094957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:40.183652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:40.184247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:40.191570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:40.192014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:40.192798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:40.193380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:40.256042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:40.267425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a807df82-2f38-4df6-8e39-eb0d93ad5cc0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.186834 Nov 19 19:52:40.268022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1482/3013] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:40 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:40.348782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:40.362306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67a90b2e-8397-4c34-9cf3-8e5cd94c23a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.182829 Nov 19 19:52:40.362896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1532/3014] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:41.289099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:41.289734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:41.297319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:41.297741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:41.298595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:41.299024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:41.380122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:41.380764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:41.388356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:41.388778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:41.389609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:41.390022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:41.520326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:41.528799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-149013a5-9fd7-400f-b7fd-5000e9dd7bf4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.243502 Nov 19 19:52:41.529391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1483/3015] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:41 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:41.567291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:41.575531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-df0730ed-108b-4446-aae5-4eda51712384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.199260 Nov 19 19:52:41.576077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1533/3016] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:42.547455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:42.548088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:42.557989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:42.558463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:42.559241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:42.559664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:42.595871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:42.596824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:42.608783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:42.608783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:42.609693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:42.610706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:42.843928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:42.850962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:42.854127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-573a52bb-ab90-4e59-b54a-8808525b84f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.264115 Nov 19 19:52:42.854733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1534/3017] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:42.860733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9195b1e3-2b5e-482f-b54b-2d79362550d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.317580 Nov 19 19:52:42.861427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1484/3018] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:42 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:43.877077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:43.877964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:43.880858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:43.881966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:43.885793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:43.886321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:43.887098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:43.887525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:43.892121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:43.892882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:43.894241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:43.894751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:44.140686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:44.154891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:44.155097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b3c62ab-ddc1-4e13-a030-443d5eafa275 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.282759 Nov 19 19:52:44.155518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1535/3019] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:44.163738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9b1cbad1-c37e-4d30-8640-8872924bd150 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.288738 Nov 19 19:52:44.164318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1485/3020] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:43 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:44.405847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:52:44.405847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:52:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:52:45.184910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:45.185664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:45.186170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:45.186328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:45.192966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:45.193702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:45.194533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:45.194972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:45.198658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:45.199540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:45.201229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:45.202002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:45.448988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:45.458363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c28b2575-5638-470c-8c24-361006b6d417 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.277224 Nov 19 19:52:45.458942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1486/3021] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:45 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:45.459753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:45.472384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ab95c224-0cbc-447a-9b25-4bb3de8d403c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.295238 Nov 19 19:52:45.472742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1536/3022] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:46.485293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:46.486148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:46.492618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:46.493287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:46.493842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:46.494302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:46.497917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:46.498971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:46.505839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:46.506319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:46.507110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:46.507542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:46.712295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:46.717326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:46.720914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f240c8ca-7a1d-44e4-928f-28d949f06bd9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.239339 Nov 19 19:52:46.721501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1487/3023] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:46 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:46.726986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8a4068f1-499b-48fa-9d96-4b24bc27c14c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.237155 Nov 19 19:52:46.727836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1537/3024] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:47.740591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:47.741368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:47.749193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:47.749642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:47.750471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:47.750904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:47.753698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:47.754842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:47.766389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:47.767109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:47.768541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:47.769229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:47.959326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:47.968118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c4ee5dac-f409-4648-824b-ec9f7a045f25 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.232491 Nov 19 19:52:47.968711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1488/3025] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:47 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:47.972574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:47.981651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d806db0a-5af5-4431-ba86-f8d06edfbf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.232872 Nov 19 19:52:47.982343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1538/3026] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:47 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:48.986487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:48.987081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:48.995382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:48.995839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:48.996634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:48.997064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:49.000736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:49.001346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:49.008031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:49.008560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:49.009360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:49.009788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:49.229994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:49.233051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:49.241528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f17638a3-6a11-4dbe-9e2c-ca10359b9641 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.258672 Nov 19 19:52:49.242019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1489/3027] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:48 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:49.242198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0fc978de-0831-40cf-9511-f9b199bc002b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.244750 Nov 19 19:52:49.252761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1539/3028] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:50.259672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:50.260346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:50.270714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:50.271317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:50.271845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:50.272225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:50.272673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:50.272935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:50.279917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:50.280363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:50.281132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:50.281557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:50.474982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:50.478447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:50.483483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-079cc018-4d8f-47c8-9072-734462376413 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.227953 Nov 19 19:52:50.484060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1490/3029] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:50 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:50.486940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f88e009d-b1f7-4d34-b627-5a1275b01456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.220723 Nov 19 19:52:50.487467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1540/3030] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:51.501219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:51.502132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:51.508560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:51.509258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:51.509911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:51.510438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:51.511292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:51.511734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:51.516448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:51.516892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:51.517723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:51.518214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:51.727194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:51.737079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-90340b88-b57e-4e70-82c6-6841844b1e60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.239763 Nov 19 19:52:51.740397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:51.742485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1491/3031] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:51 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:51.749558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-64f77550-122a-47d2-b25f-2d499bb8ff13 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.246278 Nov 19 19:52:51.750183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1541/3032] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:52.754941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:52.755583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:52.763409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:52.763752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:52.764550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:52.764983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:52.767241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:52.767857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:52.774770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:52.775215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:52.776003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:52.776445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:52.975349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:52.979800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:52.984942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3b5e6227-2d5a-4f8e-8711-01f8a0e882c9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.221297 Nov 19 19:52:52.985515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1542/3033] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:52 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:52.988423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9c557cd7-55ca-404e-885f-f3ea29977858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.237324 Nov 19 19:52:52.988996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1492/3034] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:52 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:54.004124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:54.004680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:54.005642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:54.006295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:54.011390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:54.011837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:54.012606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:54.013033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:54.013736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:54.014331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:54.015007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:54.015441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:54.236834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:54.240606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:54.245099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a28d0bb-e661-4c29-b84e-38c18f4ec717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.244735 Nov 19 19:52:54.245684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1543/3035] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:54.249379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ec86d3a0-afe0-46d5-8eac-36e930e4e2c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.247232 Nov 19 19:52:54.250152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1493/3036] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:54 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:55.262755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:55.263359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:55.266613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:55.267253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:55.270072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:55.270523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:55.271342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:55.271770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:55.273828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:55.274306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:55.275464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:55.275906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:55.471249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:55.478964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:55.480032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4d4933ab-b276-421c-ba49-c3e3c643a6cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.221456 Nov 19 19:52:55.480624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1544/3037] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:55.487104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2a8dbc63-6db9-4b39-9d7f-76099afd5669 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.224150 Nov 19 19:52:55.487652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1494/3038] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:55 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:56.496884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:56.497539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:56.504001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:56.504609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:56.504728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:56.504841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:56.505535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:56.505960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:56.511781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:56.512335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:56.513406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:56.514009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:56.715324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:56.719715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:56.724157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-adda6d80-dbf9-4121-8810-f2205b0a1955 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.230956 Nov 19 19:52:56.724966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1545/3039] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:56.733208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d3cc3835-8065-48de-b998-009969f4e915 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.228199 Nov 19 19:52:56.733208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1495/3040] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:56 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:57.743203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:57.744235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:57.745638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:57.746926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:57.754903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:57.755658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:57.756820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:57.757259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:57.757599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:57.757929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:57.758794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:57.759657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:57.964895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:57.969982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:57.975620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-65bbd989-1545-44f2-a40e-e2089eda9658 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.236703 Nov 19 19:52:57.982144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-587c749e-4df0-40f0-81f7-1a031d3c6af3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.239441 Nov 19 19:52:57.985972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1496/3041] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:57 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:57.986398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1546/3042] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:57 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:52:58.997149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:58.997884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:58.999726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:52:59.000418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:52:59.005225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:59.005701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:59.006595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:59.007105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:59.007326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:59.007777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:59.008546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:52:59.008971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:52:59.230669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:59.235014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:52:59.240007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bce75650-0181-478e-8fe1-944557b83f43 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.248367 Nov 19 19:52:59.240679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1497/3043] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:52:59.244540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8f17183-fb5d-4fd2-99d7-a098d663737e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.248454 Nov 19 19:52:59.245162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1547/3044] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:52:58 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:00.258706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:00.259331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:00.262390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:00.262968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:00.266589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:00.267046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:00.267845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:00.268275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:00.270176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:00.270626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:00.271424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:00.271838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:00.478530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:00.486936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb04c713-ee3c-42c8-89f9-8492a2c63a84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.228479 Nov 19 19:53:00.487626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1548/3045] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:00 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:00.491533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:00.499857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0cb90292-8512-4f73-abfc-2883cfb600e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.245948 Nov 19 19:53:00.500445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1498/3046] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:01.505007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:01.505659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:01.514155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:01.514599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:01.515378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:01.515805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:01.517590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:01.518242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:01.525009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:01.525501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:01.526649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:01.527451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:01.742704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:01.748512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:01.751852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b9db2d0-93cf-4e49-b921-a2d43a930194 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.250546 Nov 19 19:53:01.752468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1549/3047] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:01 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:01.763386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c09ceb26-e240-4d1e-a760-dd615003961a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.248904 Nov 19 19:53:01.764301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1499/3048] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:02.775559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:02.776250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:02.782088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:02.782699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:02.783838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:02.784270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:02.785068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:02.785476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:02.788911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:02.789386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:02.790385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:02.791117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:03.015662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:03.025451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-69b1e847-e2e3-470c-81ce-25c99afa36e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.252966 Nov 19 19:53:03.027151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:03.034523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1550/3049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:02 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:03.040724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-12b1e096-3ac5-40c2-a342-3921bcc52028 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.262361 Nov 19 19:53:03.042000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1500/3050] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:04.043518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:04.044186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:04.051150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:04.051646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:04.052442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:04.052878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:04.067446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:04.068485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:04.078710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:04.079294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:04.080331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:04.081104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:04.264052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:04.272509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6982634b-6786-4099-8970-698a64ac66e0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.232779 Nov 19 19:53:04.273106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1551/3051] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:04 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:04.289839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:04.298673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f62b4d0d-b246-4688-8910-9e48472ae36e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.237931 Nov 19 19:53:04.299264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1501/3052] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:05.290493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:05.291164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:05.299100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:05.299543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:05.300324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:05.300750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:05.316689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:05.317686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:05.325833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:05.326353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:05.327112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:05.327537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:05.810782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:05.814450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:05.818880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ded70ec-9f19-481a-8a0a-9aeffd44441d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.532193 Nov 19 19:53:05.819448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1552/3053] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:05 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:05.822604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de092d36-b161-4c3b-8172-1724beddd2d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.509780 Nov 19 19:53:05.823184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1502/3054] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:06.837346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:06.837975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:06.839741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:06.840382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:06.845505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:06.845978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:06.846796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:06.847223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:06.847478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:06.847932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:06.848716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:06.849154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:07.054780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:07.060358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:07.064045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-50a6f3b3-92b8-4548-86a9-58815c657e7d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.230307 Nov 19 19:53:07.064647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1553/3055] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:06 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:07.069919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8c9f93e-f8b4-4e6e-aa2a-85dd71e001f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.233779 Nov 19 19:53:07.070541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1503/3056] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:06 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:08.082250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:08.082966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:08.088064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:08.089276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:08.091103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:08.091542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:08.092370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:08.092805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:08.096227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:08.096759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:08.097468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:08.098031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:08.325293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:08.327533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:08.339129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d74f94b6-8350-46c8-a0e1-c1f3989ea148 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.254317 Nov 19 19:53:08.340196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1504/3057] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:08.348625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6304bb4-ecca-4c46-b105-c7aae39ee147 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.265247 Nov 19 19:53:08.348625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1554/3058] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:08 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:09.367103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:09.367936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:09.368800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:09.370144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:09.374923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:09.375407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:09.376389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:09.376829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:09.381049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:09.381949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:09.383316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:09.384078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:09.589606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:09.598549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:09.598849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c034e4eb-b66a-469e-b38e-2c43915b4c8b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.236758 Nov 19 19:53:09.599326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1505/3059] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:09 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:09.612217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3176021a-2899-4f95-86de-12bc4fbcd719 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.249409 Nov 19 19:53:09.613220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1555/3060] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:10.617950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:10.618586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:10.626008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:10.626746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:10.627541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:10.627974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:10.632460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:10.633105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:10.643082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:10.643812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:10.645174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:10.645921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:10.891140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:10.902705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34880d19-e538-4dc7-84a4-e805af39ed2b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.288809 Nov 19 19:53:10.903450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1506/3061] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:10 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:10.907134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:10.918369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-031b6bb1-c027-4e90-95dd-1290e9b3250b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.289714 Nov 19 19:53:10.918958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1556/3062] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:11.921588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:11.922309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:11.929533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:11.929976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:11.930831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:11.931249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:11.941305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:11.942475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:11.953879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:11.954684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:11.956058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:11.956812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:12.156835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:12.168492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d93f0e2d-3f09-416c-bfa9-1b431d82cb60 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.250394 Nov 19 19:53:12.169444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1507/3063] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:11 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:12.172701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:12.188153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d3144a59-2ae0-419c-9deb-0118c58ba34a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.253563 Nov 19 19:53:12.189134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1557/3064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:13.199184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:13.200353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:13.206766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:13.207380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:13.211393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:13.212100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:13.213945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:13.214755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:13.214868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:13.215288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:13.216446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:13.216873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:13.444915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:13.454689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f8ea8972-486f-4ff1-b160-979bb3ca9a72 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.262524 Nov 19 19:53:13.455857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1508/3065] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:13 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:13.460695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:13.475676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-65de350a-1f5d-4724-9294-272c0d1ff8c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.272180 Nov 19 19:53:13.477157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1558/3066] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:14.480939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:14.482024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:14.489355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:14.489786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:14.490645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:14.491074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:14.502195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:14.502965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:14.513393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:14.513781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:14.514796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:14.515544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:14.722763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:14.727733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:14.732174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fcc7e218-af75-49d2-9101-6d6d1c7eff54 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.255146 Nov 19 19:53:14.732767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1509/3067] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:14 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:14.737455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2c131690-c42b-4a0b-a96f-02111232eab9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.241048 Nov 19 19:53:14.738154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1559/3068] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:15.750085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:15.750699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:15.754391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:15.755567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:15.757121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:15.757565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:15.758466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:15.759336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:15.762415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:15.762877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:15.764272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:15.764701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:15.960246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:15.965516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:15.969375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-389af268-3396-4173-a246-e9924b138773 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.222997 Nov 19 19:53:15.969954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1510/3069] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:15 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:15.974327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3c24307-0983-4f58-920f-5cc9c5f7852b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223453 Nov 19 19:53:15.974930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1560/3070] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:16.986679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:16.987291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:16.994009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:16.994617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:16.995715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:16.996151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:16.999595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:17.003417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:17.006830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:17.007271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:17.008045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:17.008467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:17.214225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:17.221862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:17.230600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b6de7af2-e76c-4451-a2ca-9e8e965328df tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.247272 Nov 19 19:53:17.231702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1511/3071] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:16 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:17.235945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a32c8ac7-b178-4b4b-8140-221f35bbfd4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.239901 Nov 19 19:53:17.237061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1561/3072] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:18.255763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:18.256418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:18.259623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:18.260628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:18.263165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:18.263609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:18.264414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:18.264839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:18.268374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:18.268824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:18.269585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:18.270024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:18.470331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:18.474164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:18.478738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-10befd41-6617-4424-abd3-d257f0f7469e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.226958 Nov 19 19:53:18.479420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1512/3073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:18 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:18.482565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7661b336-c711-4b68-8845-7f60fa3fe5f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227829 Nov 19 19:53:18.483468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1562/3074] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:19.498751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:19.499440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:19.504330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:19.504909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:19.505782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:19.506254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:19.507127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:19.507594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:19.511588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:19.512063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:19.512792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:19.513425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:19.706956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:19.710399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:19.715355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a83e4de8-1fe2-41ac-a474-dfa769e84ebf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.220931 Nov 19 19:53:19.719625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5f8a2463-71b6-4947-9003-1b0c5fa64384 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.218902 Nov 19 19:53:19.719961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1513/3075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:19 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:19.720291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1563/3076] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:20.737814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:20.738455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:20.739570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:20.740183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:20.745019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:20.745459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:20.746289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:20.746755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:20.748332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:20.748787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:20.749698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:20.750306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:20.950828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:20.954885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:20.959433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1cd0c73-36bb-45ae-821d-20c0fb4b44b8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.223409 Nov 19 19:53:20.960019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1564/3077] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:20.963467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0752e000-ad29-4d9f-bac1-2ea99a1df6f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.229118 Nov 19 19:53:20.964165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1514/3078] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:20 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:21.976652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:21.977263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:21.980512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:21.981130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:21.984063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:21.984511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:21.985278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:21.985701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:21.987504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:21.987986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:21.988766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:21.989170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:22.194867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:22.198216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:22.203557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-820ce97f-63a7-4e3b-8908-21e2941b80f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.226583 Nov 19 19:53:22.204146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1515/3079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:21 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:22.206820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb89ef8b-e65e-4eb4-b63f-b0a6afefd623 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.233565 Nov 19 19:53:22.207465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1565/3080] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:23.221315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:23.221870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:23.226262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:23.226894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:23.228758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:23.229205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:23.229982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:23.230426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:23.234104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:23.234585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:23.235355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:23.235780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:23.435879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:23.440971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:23.446567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c98f624c-1f1e-4221-b924-7226963ee806 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.228728 Nov 19 19:53:23.447818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1516/3081] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:23 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:23.448845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae935725-ef32-4211-b480-ac0039140efb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.226099 Nov 19 19:53:23.449544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1566/3082] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:24.469155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:24.469760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:24.473118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:24.475071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:24.476574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:24.477132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:24.477787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:24.478253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:24.482810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:24.484040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:24.484847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:24.485284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:24.683674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:24.687173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:24.692129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4c556bee-469f-4919-acfd-613edd179fa2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.230312 Nov 19 19:53:24.692717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1517/3083] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:24 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:24.694971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1828cd71-0930-48ec-aab1-e5b3232ad0ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227040 Nov 19 19:53:24.695560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1567/3084] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:25.710132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:25.710738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:25.712276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:25.713212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:25.719368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:25.719902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:25.720580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:25.721004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:25.721319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:25.722119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:25.722546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:25.723021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:25.930813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:25.939086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:25.939565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c5860c7-0aca-4d71-bd74-9b1e0f91c908 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.233239 Nov 19 19:53:25.940343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1518/3085] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:25 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:25.949901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5fb9f2c7-d6cb-4bb2-a97a-6142b45be9d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.241977 Nov 19 19:53:25.950521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1568/3086] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:26.967323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:26.968172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:26.971174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:26.972102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:26.976426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:26.977013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:26.977956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:26.978466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:26.981443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:26.982038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:26.982972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:26.983546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:27.201653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:27.211349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e78625ff-7838-46d7-9799-8117d356e838 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.250732 Nov 19 19:53:27.212611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:27.214818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1519/3087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:26 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:27.231250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-455436aa-340b-4a04-b3a2-8c5c9740c2da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.264035 Nov 19 19:53:27.231981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1569/3088] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:28.233284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:28.233861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:28.240523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:28.240970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:28.241743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:28.242208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:28.248735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:28.250165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:28.257786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:28.258451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:28.259415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:28.259848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:28.440384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:28.451175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5502be5e-525b-4493-81a3-364148b17dea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.221514 Nov 19 19:53:28.451882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1520/3089] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:28 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:28.456247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:28.466447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cffac86b-5563-45e9-b789-e39f917583f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.221507 Nov 19 19:53:28.467015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1570/3090] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:29.468937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:29.469574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:29.476358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:29.476865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:29.477633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:29.478135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:29.483267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:29.483947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:29.490564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:29.491113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:29.491958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:29.492398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:29.677853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:29.682884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:29.690709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-515f537c-289c-4057-b12c-2f57a84760e1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.225795 Nov 19 19:53:29.691656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1521/3091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:29 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:29.694277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-987a9deb-dc11-42c0-aa2f-a9cb9f9fcf1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.214627 Nov 19 19:53:29.694981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1571/3092] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:30.709125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:30.709775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:30.712218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:30.712828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:30.716876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:30.717321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:30.718093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:30.718550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:30.720933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:30.721382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:30.722185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:30.722620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:30.930955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:30.934591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:30.939695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7ab89ac7-7a14-4c09-9fe2-6ee166304419 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.234404 Nov 19 19:53:30.940282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1522/3093] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:30 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:30.943034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9a859eee-2ef2-4ee1-846a-7abbf1615be4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.235185 Nov 19 19:53:30.943590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1572/3094] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:31.959581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:31.960450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:31.962427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:31.964333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:31.972256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:31.972561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:31.972931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:31.973153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:31.974084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:31.974377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:31.974595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:31.974867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:32.196518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:32.202245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:32.208488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f95b7b7a-7237-415e-b624-6c94d085993d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.250607 Nov 19 19:53:32.209408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1573/3095] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:32.212613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b67ca2b-5000-4c01-8b29-9d5941216e88 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.258333 Nov 19 19:53:32.213412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1523/3096] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:31 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:33.229841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:33.230480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:33.231963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:33.232587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:33.238152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:33.238594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:33.239377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:33.239507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:33.239802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:33.239937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:33.240656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:33.241087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:33.443291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:33.446849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:33.454075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd72e254-0b45-4f73-a748-06883815be83 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.226219 Nov 19 19:53:33.454606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1524/3097] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:33 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:33.458527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1eb2b4ff-af11-4c49-b146-ef2d82afa88a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.233810 Nov 19 19:53:33.459027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1574/3098] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:34.472408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:34.473083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:34.476751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:34.477350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:34.479949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:34.480423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:34.481351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:34.481666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:34.483791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:34.484116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:34.484866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:34.485293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:34.684491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:34.688762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:34.696062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f4d680e-cf1f-42d5-9ae6-4d08a425fe84 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.227161 Nov 19 19:53:34.696746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1525/3099] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:34 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:34.701073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6cd2935b-f861-40d7-a3c0-1b0e399095f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227693 Nov 19 19:53:34.702151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1575/3100] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:35.713107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:35.713708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:35.720481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:35.720922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:35.721691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:35.721807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:35.722276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:35.722658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:35.729443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:35.729977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:35.730861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:35.731401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:35.917040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:35.920623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:35.926170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a34dbcb2-c643-4956-845b-c29b7441b774 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.216596 Nov 19 19:53:35.926774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1526/3101] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:35 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:35.929011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-94710833-92d1-4088-804b-987f23999729 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.211117 Nov 19 19:53:35.929568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1576/3102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:36.944402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:36.944969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:36.946832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:36.947450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:36.951454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:36.951898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:36.952671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:36.953133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:36.955161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:36.955665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:36.956493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:36.956924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:37.148201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:37.153022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:37.161859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-045083eb-99e6-404d-bd31-4dc35076e805 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.220980 Nov 19 19:53:37.162550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1527/3103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:36 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:37.166161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-739a34d2-79a0-44ed-bd53-c7e6bb90d490 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.222761 Nov 19 19:53:37.166980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1577/3104] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:38.182081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:38.182730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:38.186562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:38.187145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:38.189699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:38.190356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:38.191137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:38.191566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:38.193892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:38.194370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:38.195141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:38.195569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:38.391383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:38.394457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:38.400546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9e7ee5e8-0786-4afb-891c-3be5408eef07 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.218131 Nov 19 19:53:38.401219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1578/3105] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:38.404081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd197c48-6e7f-45c3-ba30-06f3dc4b9e53 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.226761 Nov 19 19:53:38.404651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1528/3106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:38 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:39.419236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:39.419889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:39.420880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:39.421311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:39.426814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:39.428765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:39.428765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:39.429016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:39.429130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:39.429239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:39.429354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:39.429979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:39.632264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:39.635973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:39.640643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-058a3a7e-b9cb-4ab9-b055-62b03015390e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.226015 Nov 19 19:53:39.641188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1579/3107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:39.644112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-715363fa-9a9c-4742-845d-a1c059d83d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.227154 Nov 19 19:53:39.644643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1529/3108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:39 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:40.659079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:40.659666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:40.661343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:40.661953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:40.666235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:40.666680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:40.667447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:40.667858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:40.668542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:40.668975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:40.669755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:40.670209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:40.861275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:40.864711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:40.870080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8b4a558-f67d-4a30-aa06-20c51b8d9e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.214589 Nov 19 19:53:40.870753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1580/3109] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:40.874413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0cba0316-3e50-4473-8936-d20d7c603634 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.216998 Nov 19 19:53:40.875249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1530/3110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:40 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:41.888512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:41.889797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:41.891495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:41.892137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:41.896759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:41.897219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:41.897985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:41.898938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:41.899319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:41.899461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:41.900234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:41.900668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:42.103895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:42.111759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:42.112445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-590d9d9f-f662-4e5b-b8ad-456338e8071c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.227618 Nov 19 19:53:42.113229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1581/3111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:42.120380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8343523-f2cc-4add-8f82-7304f4e0ceb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.232428 Nov 19 19:53:42.120937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1531/3112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:41 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:43.132917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:43.133503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:43.137745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:43.138413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:43.140437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:43.140896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:43.141701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:43.142133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:43.145413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:43.145856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:43.146654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:43.147080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:43.352118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:43.359971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:43.363367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-38f1444d-56aa-4dc7-ad96-72f5f2c121da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.236808 Nov 19 19:53:43.363966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1582/3113] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:43.368620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-77668736-518b-4f2b-b605-0d77d3b37675 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.234942 Nov 19 19:53:43.369284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1532/3114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:43 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:44.384766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:44.385344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:44.388419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:44.389039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:44.394873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:44.395474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:44.396497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:44.397082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:44.398535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:44.399087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:44.400152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:44.400657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:44.593292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:44.601985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af9aa898-977b-4958-9417-80e6934c27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.222944 Nov 19 19:53:44.602644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1583/3115] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:44.603006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:44.611342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9d51bf4-f8d7-4a4c-88f9-9e619c143c2e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.228043 Nov 19 19:53:44.611936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1533/3116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:44 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:45.618997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:45.619589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:45.626359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:45.626968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:45.627727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:45.628398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:45.628542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:45.629132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:45.635710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:45.636161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:45.636944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:45.637374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:45.825654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:45.832794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:45.834959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-078cc8b8-3d0b-4d4a-b8de-07749fa51ed4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.219544 Nov 19 19:53:45.835532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1584/3117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:45.839804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:45.840844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:45.841895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3c19407-e468-4077-91fd-061e0a142cc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.217609 Nov 19 19:53:45.848665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1534/3118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:45 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:45.848792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:45.848792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:45.848792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:45.849080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:45.875826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:53:45.882582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.compute.api [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Working on deleting snapshot 8d20dcb5-6a0b-4b9b-b4ee-127ae3596b9c from shelved instance... Nov 19 19:53:46.622703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Doing local delete in cell c12fc2f6-cd8d-4c14-9fdc-caa783139795(cell1) {{(pid=116111) _delete /opt/stack/nova/nova/compute/api.py:2439}} Nov 19 19:53:46.623566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:46.624236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:46.624889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.compute.api [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Nov 19 19:53:46.633086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] deallocate_for_instance() {{(pid=116111) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1676}} Nov 19 19:53:46.854091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:46.854804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:46.861566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:46.862624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:46.862885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:46.863317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:47.152272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:47.161382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dcefb838-9061-40c2-ad4e-83c441470ee2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.311106 Nov 19 19:53:47.170818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1535/3119] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:47.175477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:47.176087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: e13558fb-6c01-4fec-8683-7cf251c8e43e] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:47.182709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:47.183274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:47.183946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:47.184405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:47.626068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:47.634637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5f20fddf-fe28-4df5-98cc-54e0439c2373 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e" status: 200 len: 1561 microversion: 2.1 time: 0.462831 Nov 19 19:53:47.635870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1536/3120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:47 2021] GET /compute/v2.1/servers/e13558fb-6c01-4fec-8683-7cf251c8e43e => generated 1561 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:48.075619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Updating instance_info_cache with network_info: [] {{(pid=116111) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Nov 19 19:53:48.076173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-531830a2-629e-40ca-976d-2436efac29e1 req-f6831435-9e56-42f9-b4a1-d5d14c6bcddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35ef8da0-cc9a-484a-b675-ce4bbc67b34d", "name": "network-vif-deleted", "tag": "a3960fce-279b-4070-adf3-d00c4dc6f1b3"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:53:48.077543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:53:48.077543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:53:48.086277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-531830a2-629e-40ca-976d-2436efac29e1 req-f6831435-9e56-42f9-b4a1-d5d14c6bcddd service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:48.086793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-531830a2-629e-40ca-976d-2436efac29e1 req-f6831435-9e56-42f9-b4a1-d5d14c6bcddd service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:48.101590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.compute.server_external_events [req-531830a2-629e-40ca-976d-2436efac29e1 req-f6831435-9e56-42f9-b4a1-d5d14c6bcddd service nova] Unable to find a host for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d. Dropping event network-vif-deleted {{(pid=116110) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Nov 19 19:53:48.102691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-531830a2-629e-40ca-976d-2436efac29e1 req-f6831435-9e56-42f9-b4a1-d5d14c6bcddd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.031885 Nov 19 19:53:48.103474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1537/3121] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:53:48 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 19 19:53:48.178376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:48.179051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:48.185726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:48.186314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:48.187198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:48.187743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:48.416959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:48.431238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-850cd37b-3fc7-4fa4-97bf-2cbdebd0c0ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.256820 Nov 19 19:53:48.431849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1538/3122] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:53:48.476434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.scheduler.client.report [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Deleted allocations for instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d Nov 19 19:53:48.624808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b0b46875-a90f-4bc4-be44-b8a8e3588aa2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 204 len: 0 microversion: 2.20 time: 2.788017 Nov 19 19:53:48.625585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1585/3123] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Nov 19 19:53:45 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 0 bytes in 2789 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 19:53:48.634642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:48.635256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:48.641367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:48.641838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:48.642708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:48.643258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:48.658039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d could not be found. Nov 19 19:53:48.658749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 404 to user: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:53:48.659588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-25a0aa2a-98df-4bc3-b57c-aa21a7b0189f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 404 len: 111 microversion: 2.20 time: 0.028956 Nov 19 19:53:48.660140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1539/3124] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:48 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 19:53:48.669572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8c53946e-4b41-44b1-b214-b91280f1e0db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '.version_select at 0x7fc14cab4ca0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:48.688373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8c53946e-4b41-44b1-b214-b91280f1e0db tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562443595" status: 204 len: 0 microversion: 2.20 time: 0.023225 Nov 19 19:53:48.689201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1586/3125] 10.222.0.46 () {60 vars in 1258 bytes} [Fri Nov 19 19:53:48 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562443595 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 19:53:49.450897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:49.451527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:49.458590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:49.459040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:49.459815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:49.460250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:49.579707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d7aa9cb-9b7e-4e72-94df-1dfbe414abdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'create', calling method: .version_select at 0x7fc14c987430>, body: {"keypair": {"name": "tempest-keypair-2115588660"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:53:49.597620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-5d7aa9cb-9b7e-4e72-94df-1dfbe414abdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:53:49.602609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-5d7aa9cb-9b7e-4e72-94df-1dfbe414abdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for user 5416c05854a84428a3253dc8f373dce3 and project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:53:49.606213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:49.615428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-44bf8df6-12a0-4407-80d2-97f40fcf8d74 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.169051 Nov 19 19:53:49.616621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1540/3126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:49.764779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-5d7aa9cb-9b7e-4e72-94df-1dfbe414abdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:53:49.768672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-5d7aa9cb-9b7e-4e72-94df-1dfbe414abdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for user 5416c05854a84428a3253dc8f373dce3 and project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:53:49.782113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d7aa9cb-9b7e-4e72-94df-1dfbe414abdf tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.206465 Nov 19 19:53:49.782876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1587/3127] 10.222.0.46 () {62 vars in 1198 bytes} [Fri Nov 19 19:53:49 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 208 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Nov 19 19:53:50.633703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:50.634357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:50.640852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:50.641291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:50.642367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:50.644031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:50.898164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:50.906910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f36437e-18a6-4477-b7a3-d97355ad08d0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.276909 Nov 19 19:53:50.907698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1541/3128] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:51.227090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1205090615", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb3bf421-2641-4240-bd79-b0e181858287"}], "security_groups": [{"name": "tempest-securitygroup--395090933"}], "key_name": "tempest-keypair-2115588660", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:53:51.350595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.network.neutron [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] validate_networks() for [('bb3bf421-2641-4240-bd79-b0e181858287', None, None, None, None, None)] {{(pid=116111) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:53:51.805070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Flavor limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:53:51.805491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Image limits 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:53:51.805997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Flavor pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:53:51.806435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Image pref 0:0:0 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:53:51.806843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.virt.hardware [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116111) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:53:51.816428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:51.816869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:51.817657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:51.818091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:51.834905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:53:51.839074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Getting quotas for user 5416c05854a84428a3253dc8f373dce3 and project c347e63d053a44c0b82b72c18fcbad8d. Resources: {'cores', 'ram', 'instances'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:53:51.852110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Going to run 1 instances... {{(pid=116111) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:53:51.854567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116111) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:53:51.907184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: ERROR oslo.messaging._drivers.impl_rabbit [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [f87c0710-ad4d-4ddd-a16e-e1296f84eb96] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 19 19:53:51.925274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:51.925892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:51.932624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:51.933084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:51.933916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:51.934408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:52.077221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:52.086006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa61fb31-136d-4082-b0d8-e10e753f3c2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.164440 Nov 19 19:53:52.086712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1542/3129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:52.930811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [f87c0710-ad4d-4ddd-a16e-e1296f84eb96] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 55982. Nov 19 19:53:52.936088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-02f98cc5-aa41-4171-83ac-0f61795c9e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.717444 Nov 19 19:53:52.936750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1588/3130] 10.222.0.46 () {62 vars in 1187 bytes} [Fri Nov 19 19:53:51 2021] POST /compute/v2.1/servers => generated 401 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Nov 19 19:53:52.947214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7802a834-dab9-4843-b4ab-1658f17c48fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:52.948102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7802a834-dab9-4843-b4ab-1658f17c48fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:53.004128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7802a834-dab9-4843-b4ab-1658f17c48fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:53.011848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7802a834-dab9-4843-b4ab-1658f17c48fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:53.013381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7802a834-dab9-4843-b4ab-1658f17c48fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:53.014559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7802a834-dab9-4843-b4ab-1658f17c48fa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1282 microversion: 2.20 time: 0.071244 Nov 19 19:53:53.015120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1543/3131] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:52 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:53:53.104141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:53.104828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:53.111494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:53.111944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:53.112757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:53.113142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:53.262792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:53.271014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d291d89a-49f4-4c2d-a02c-4cb55e91f683 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.170547 Nov 19 19:53:53.271830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1589/3132] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:53 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:54.033063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:54.034379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:54.041557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:54.042271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:54.043034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:54.043649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:54.122967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:54.131822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:54.134008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:54.135408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5bab9cc0-3197-4d89-bed1-012e5fab37b2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1342 microversion: 2.20 time: 0.106579 Nov 19 19:53:54.136259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1544/3133] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:54 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1342 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 19:53:54.288856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:54.289478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:54.296008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:54.296409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:54.297170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:54.297641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:54.699405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:54.707570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0cc9808e-6962-4ee3-9790-63898e8a155f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.422326 Nov 19 19:53:54.708228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1590/3134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:55.154150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:55.154761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:55.161507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:55.161952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:55.164459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:55.164830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:55.403868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:55.414034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:55.416092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:55.417444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dbcda6ee-18eb-41af-80af-f2565743e9d7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.267458 Nov 19 19:53:55.418253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1545/3135] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:55 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:53:55.632093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-51622f06-b49c-4fa4-aa01-58bdee8ea9e9 req-7664ce1e-0e18-4728-921a-cbdf5d14e1aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:53:55.634463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:53:55.634463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:53:55.644489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-51622f06-b49c-4fa4-aa01-58bdee8ea9e9 req-7664ce1e-0e18-4728-921a-cbdf5d14e1aa service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:55.645170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-51622f06-b49c-4fa4-aa01-58bdee8ea9e9 req-7664ce1e-0e18-4728-921a-cbdf5d14e1aa service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:55.659074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-51622f06-b49c-4fa4-aa01-58bdee8ea9e9 req-7664ce1e-0e18-4728-921a-cbdf5d14e1aa service nova] Creating event network-changed:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 19:53:55.667145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-51622f06-b49c-4fa4-aa01-58bdee8ea9e9 req-7664ce1e-0e18-4728-921a-cbdf5d14e1aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039411 Nov 19 19:53:55.667974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1591/3136] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:53:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:53:55.727123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:55.728039 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:55.735278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:55.735996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:55.736813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:55.737339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:55.960229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:55.969173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6cbdd82c-ae89-4b3f-9d13-f963d2eed372 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.246240 Nov 19 19:53:55.969783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1546/3137] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:56.438327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:56.439204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:56.446150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:56.446696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:56.447521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:56.447957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:56.640452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:53:56.641089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:53:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:53:56.914325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:56.922802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:56.924297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:56.925686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4bbcf683-51f5-452a-8fed-0a327a251b64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.492100 Nov 19 19:53:56.926427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1592/3138] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:56 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:53:56.987532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:56.988179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:56.995830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:56.996278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:56.997063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:56.997496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:57.190909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:57.199864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c64470fc-9313-48c9-81e4-425d45a328b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.216032 Nov 19 19:53:57.200505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1547/3139] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:57.944770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:57.945431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:57.951801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:57.952251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:57.952999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:57.953426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:58.131022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:58.139352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:58.140870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:58.142068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32d002f9-883b-4b11-9db3-57db573e148b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.201473 Nov 19 19:53:58.142692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1593/3140] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:57 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:53:58.217800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:58.218560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:58.227353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:58.227898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:58.228849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:58.229439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:58.375815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:58.384168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ea222a2b-a138-4dda-bfb6-b52ef1780bbe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.170635 Nov 19 19:53:58.384774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1548/3141] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:53:59.163068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:59.163670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:59.172468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:59.172904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:59.173692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:59.174149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:59.324951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:59.333154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:59.334993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:59.336165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cd892afd-0da8-488b-b080-bf6adb886be6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.179102 Nov 19 19:53:59.336725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1594/3142] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:53:59 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:53:59.404736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:53:59.405335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:53:59.412832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:59.413738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:59.414487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:53:59.416054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:53:59.561306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:53:59.569632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c82bf514-c038-42c6-85e3-1fbf99c2f1f1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.168609 Nov 19 19:53:59.570232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1549/3143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:53:59 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:00.354525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:00.355113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:00.361937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:00.362415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:00.363192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:00.363625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:00.509113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:00.517162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:00.518664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:00.519802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-38eabf32-9ff6-454d-b743-ec1e91cae831 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.169042 Nov 19 19:54:00.520335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1595/3144] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:54:00 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:54:00.587975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:00.588574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:00.595674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:00.596123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:00.596905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:00.597338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:00.743311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:00.755785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e4e1029-3abf-49ec-9506-a7f75a5fc98d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.171496 Nov 19 19:54:00.756829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1550/3145] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:01.451474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-967e3e6d-5b68-4d4d-bf0a-f9f2c0796a85 req-a444d540-383b-4e93-b66d-6bbbb657678d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "name": "network-vif-plugged", "status": "completed", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:01.453128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:54:01.453128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:54:01.460231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-967e3e6d-5b68-4d4d-bf0a-f9f2c0796a85 req-a444d540-383b-4e93-b66d-6bbbb657678d service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:01.460638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-967e3e6d-5b68-4d4d-bf0a-f9f2c0796a85 req-a444d540-383b-4e93-b66d-6bbbb657678d service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:01.472225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-967e3e6d-5b68-4d4d-bf0a-f9f2c0796a85 req-a444d540-383b-4e93-b66d-6bbbb657678d service nova] Creating event network-vif-plugged:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 19:54:01.477503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-967e3e6d-5b68-4d4d-bf0a-f9f2c0796a85 req-a444d540-383b-4e93-b66d-6bbbb657678d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098022 Nov 19 19:54:01.478146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1596/3146] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:54:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:54:01.538657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:01.539264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:01.546357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:01.546854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:01.547670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:01.548104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:01.716790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:01.725179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:01.726760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:01.727874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f6a90166-af59-407b-b81e-eafeb8b3a192 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.193491 Nov 19 19:54:01.728439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1551/3147] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:54:01 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:54:01.773937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:01.774680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:01.781158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:01.781610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:01.782409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:01.782843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:01.926867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:01.935961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4982585-2cf7-43a7-9a63-48104514d198 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166431 Nov 19 19:54:01.936525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1597/3148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:02.751436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:02.752051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:02.761423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:02.762078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:02.763237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:02.763837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:02.930387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:02.938936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:02.940516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:02.941755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2665af68-ef4f-490b-9fb8-6f9b415fa079 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1407 microversion: 2.20 time: 0.198100 Nov 19 19:54:02.942459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1552/3149] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:54:02 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:54:02.953445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:02.954039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:02.963337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:02.964036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:02.965207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:02.966696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:03.128092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:03.141769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ea169cf-f8af-4144-b82d-39798eadc117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.191696 Nov 19 19:54:03.142400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1598/3150] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:03.962098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:03.962937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:03.969941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:03.970521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:03.971307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:03.971745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:04.120492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:04.130710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:04.132233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:04.133403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c0bef02-4759-4e3d-a2cc-84d4567d75bc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1600 microversion: 2.20 time: 0.177037 Nov 19 19:54:04.133965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1553/3151] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 19:54:03 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:54:04.151021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:04.151560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:04.159698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:04.160465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:04.161282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:04.161784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:04.163110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:04.163655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:04.167262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:04.167702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:04.168489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:04.168922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:04.280922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dd79ec00-36ca-4dd2-9383-1d259cf16955 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133571 Nov 19 19:54:04.281645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1599/3152] 10.222.0.46 () {60 vars in 1315 bytes} [Fri Nov 19 19:54:04 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:54:04.352403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:04.361281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-135a0a94-99b5-493b-9f51-faa680f439de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.205349 Nov 19 19:54:04.361873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1554/3153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:54:05.379411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:05.380289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:05.388887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:05.389325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:05.390361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:05.390798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:05.541494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:05.547852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:05.548827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:05.551037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5782b4d-3a74-497b-b020-c3240d1387a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175363 Nov 19 19:54:05.551629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1600/3154] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:05.556285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:05.556787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:05.557574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:05.558010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:05.625598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc8adfe6-906a-4b30-91a7-f7b8357ac7cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.081425 Nov 19 19:54:05.626954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1555/3155] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:05 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:05.630412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-3ed990f7-806f-4ddd-b17a-9df570f0dbc1 req-518e6660-0cd1-449d-a1f2-a66aa4465770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:05.632165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:54:05.632165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:54:05.639844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3ed990f7-806f-4ddd-b17a-9df570f0dbc1 req-518e6660-0cd1-449d-a1f2-a66aa4465770 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:05.640286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-3ed990f7-806f-4ddd-b17a-9df570f0dbc1 req-518e6660-0cd1-449d-a1f2-a66aa4465770 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:05.652209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-3ed990f7-806f-4ddd-b17a-9df570f0dbc1 req-518e6660-0cd1-449d-a1f2-a66aa4465770 service nova] Creating event network-changed:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 19:54:05.657697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-3ed990f7-806f-4ddd-b17a-9df570f0dbc1 req-518e6660-0cd1-449d-a1f2-a66aa4465770 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104674 Nov 19 19:54:05.658360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1601/3156] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:54:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:54:06.569198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:06.570038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:06.577344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:06.577788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:06.578606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:06.579027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:06.637937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:06.639460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:06.647537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:06.648263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:06.649096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:06.649741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:06.719635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2e2ab0e1-96b0-44aa-a978-c587d72cf893 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.085911 Nov 19 19:54:06.723256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1602/3157] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:06 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:54:06.733320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:06.745265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-493d94c8-8550-432a-817e-e43ac3fa1ab1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.179226 Nov 19 19:54:06.746292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1556/3158] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:06 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:07.732031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:07.733056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:07.741059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:07.741531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:07.742358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:07.742790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:07.765893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:07.766639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:07.774988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:07.775343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:07.776160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:07.776584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:07.806724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc4b78f7-82a4-439d-bfc1-280638cc9997 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.078656 Nov 19 19:54:07.807363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1603/3159] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:07 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:07.919366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:07.928257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f82977d5-61b8-411f-a957-4be630300415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165509 Nov 19 19:54:07.928890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1557/3160] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:08.818667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:08.819564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:08.826966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:08.827414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:08.828186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:08.828580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:08.890811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ceaf7bd0-0b5c-450d-a25f-9ee6c680e9c5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.076212 Nov 19 19:54:08.891460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1604/3161] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:08 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:08.945799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:08.946469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:08.953049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:08.953500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:08.954326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:08.954766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:09.104427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:09.117824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34eb7126-64bc-4d69-aa26-0c8a45c34877 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175798 Nov 19 19:54:09.118528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1558/3162] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:09.903041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:09.904037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:09.911214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:09.911662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:09.912520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:09.912948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:09.983206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d22e9e80-f022-4cc5-a7ea-b8e18509c802 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.084095 Nov 19 19:54:09.983776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1605/3163] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:09 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:10.139302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:10.139943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:10.146719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:10.147178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:10.147968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:10.148399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:10.293960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:10.304018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5aab95db-74a7-4576-8c28-9ab2a76fcdaf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.168608 Nov 19 19:54:10.304602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1559/3164] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:10.995765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:10.997007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:11.004796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:11.005356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:11.006381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:11.007149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:11.072058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fd6554c1-8832-4a6f-abfa-8ddd85602f20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.080550 Nov 19 19:54:11.072727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1606/3165] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:10 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:11.322962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:11.323613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:11.330241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:11.330694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:11.331488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:11.331918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:11.477632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:11.487681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-62a108c8-c60b-4fed-98d0-683d494176f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.169132 Nov 19 19:54:11.488632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1560/3166] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:11 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:12.085782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:12.086887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:12.095196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:12.095655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:12.096436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:12.096862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:12.174431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-91b8f628-b7d2-4e54-8e6c-7d63809faacb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.093308 Nov 19 19:54:12.175070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1607/3167] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:12 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:12.506122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:12.506848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:12.514312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:12.515128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:12.516519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:12.516952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:12.680321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:12.689159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a94a146-7f9e-4df6-a3e6-a259154afe08 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.186766 Nov 19 19:54:12.689739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1561/3168] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:12 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:13.185972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:13.187045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:13.195096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:13.195534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:13.196326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:13.196753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:13.264133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4833a07d-4291-497c-9589-af6aeeead7ce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.082275 Nov 19 19:54:13.264992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1608/3169] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:13 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:13.707387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:13.708024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:13.715011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:13.715948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:13.716878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:13.717309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:13.859991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:13.868809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e116ecbb-18cf-4fa7-b1c7-4ad5d2fcd373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165316 Nov 19 19:54:13.869427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1562/3170] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:14.276507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:14.277517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:14.285005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:14.285450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:14.286280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:14.286713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:14.351453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ead3a44a-298e-4eb4-85bd-d831d71dc925 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 14 microversion: 2.20 time: 0.079150 Nov 19 19:54:14.352084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1609/3171] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:14 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:14.886590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:14.887197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:14.896263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:14.897197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:14.897626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:14.898027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:15.048952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:15.058105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ae4cefbc-eb7a-406f-a9c3-602cb909d876 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175246 Nov 19 19:54:15.058687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1563/3172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:15.363679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:15.366036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:15.373646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:15.374145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:15.374973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:15.375428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:15.456291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d7ed332e-0d7b-425b-b184-a9cd3ee7a7a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 8819 microversion: 2.20 time: 0.096524 Nov 19 19:54:15.457467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1610/3173] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:15 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 8819 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 19:54:16.077566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:16.078225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:16.085176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:16.085634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:16.086467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:16.086904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:16.230582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:16.239098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-57140e7a-b017-4e1e-9d0d-7101b72c9c2b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165412 Nov 19 19:54:16.240015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1564/3174] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:16.472841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:16.474680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:16.486692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:16.487509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:16.488949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:16.489753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:16.569464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-99b95a29-c5d0-46c4-9108-a6defed43612 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 16503 microversion: 2.20 time: 0.104300 Nov 19 19:54:16.570309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1611/3175] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:16 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 16503 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:54:17.257694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:17.258334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:17.265215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:17.265657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:17.266493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:17.266924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:17.423976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:17.432669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00226540-7d6e-45c8-b883-53f35ac05d85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.178958 Nov 19 19:54:17.434099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1565/3176] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:17 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:17.581732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:17.582792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:17.591332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:17.591782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:17.592567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:17.592990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:17.666401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1a9af64d-55f7-405f-944b-b04e76fe7480 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 18498 microversion: 2.20 time: 0.088571 Nov 19 19:54:17.667044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1612/3177] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:17 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 18498 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:54:18.451320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:18.451943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:18.459212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:18.459655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:18.460481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:18.460910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:18.612908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:18.622624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b4d7368c-1f18-4468-bac0-3c79b94064a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175021 Nov 19 19:54:18.623222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1566/3178] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:18.679831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:18.681007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:18.688872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:18.689307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:18.690146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:18.690579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:18.774210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e21970ab-0b54-421c-8f1f-0104cd2dbedb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 20997 microversion: 2.20 time: 0.099016 Nov 19 19:54:18.774863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1613/3179] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:18 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 20997 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:19.641302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:19.641960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:19.649224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:19.649650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:19.650535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:19.650965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:19.791220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:19.792764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:19.800235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:19.804606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:19.805355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:19.806457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:19.806895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:19.808887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c93f06e8-87da-42b9-a33d-044aac1d6896 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.171798 Nov 19 19:54:19.809484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1567/3180] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:19.889270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0de21fac-95dd-459f-99c7-e5ec45b962ae tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 22988 microversion: 2.20 time: 0.105978 Nov 19 19:54:19.889941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1614/3181] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:19 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 22988 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:20.832868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:20.833521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:20.840850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:20.841526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:20.842520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:20.842952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:20.904260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:20.905276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:20.913355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:20.913794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:20.914858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:20.915289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:20.997087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7828ed01-5152-4cc0-8630-572ee09ed072 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 24240 microversion: 2.20 time: 0.096901 Nov 19 19:54:21.003747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1615/3182] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:20 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 24240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:21.034032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:21.047112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-634b90c5-5cf9-4d13-a30d-7c716b16d584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.217831 Nov 19 19:54:21.047694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1568/3183] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:22.012949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:22.014025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:22.022866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:22.023464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:22.024390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:22.024981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:22.073438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:22.074394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:22.081298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:22.082350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:22.083833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:22.084653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:22.121461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e54d796d-1ae8-4df4-be04-122011a9aee1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 25889 microversion: 2.20 time: 0.112682 Nov 19 19:54:22.122662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1616/3184] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:22 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 25889 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:22.254522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:22.263510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d69676e-b9c8-40a4-bd93-81754f7c178c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.194148 Nov 19 19:54:22.264117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1569/3185] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:23.133462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:23.134475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:23.141696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:23.142171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:23.142958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:23.143388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:23.228995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9930ef3-764d-4454-9233-a3154767f564 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 27137 microversion: 2.20 time: 0.099348 Nov 19 19:54:23.229718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1617/3186] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:23 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 27137 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:23.290935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:23.291566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:23.298255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:23.298701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:23.299466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:23.299894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:23.450963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:23.460177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a4d1a9d3-2231-4dd0-af0a-21f66de1f501 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.172987 Nov 19 19:54:23.460755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1570/3187] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:24.243476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:24.244496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:24.252032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:24.252474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:24.253287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:24.253706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:24.337211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-75ecc959-c813-4aa1-99d3-576935125e92 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 27938 microversion: 2.20 time: 0.097726 Nov 19 19:54:24.337767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1618/3188] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:24 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 27938 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:24.478562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:24.479182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:24.485993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:24.486477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:24.487257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:24.487692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:24.636374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:24.645861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76ce525a-5139-4b49-9978-082ff83c8d27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.171086 Nov 19 19:54:24.647040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1571/3189] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:25.349840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:25.350909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:25.358649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:25.359095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:25.359884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:25.360367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:25.442426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-477b0d2d-181d-4e12-8afd-109c891cf032 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28238 microversion: 2.20 time: 0.096412 Nov 19 19:54:25.443190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1619/3190] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:25 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:25.665987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:25.666772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:25.675527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:25.676186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:25.677803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:25.678469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:25.832711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:25.841232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a1f9e3eb-7416-44ac-a3c1-17ce77b45265 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.180168 Nov 19 19:54:25.841820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1572/3191] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:26.456993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:26.457887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:26.467834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:26.468475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:26.469736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:26.470452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:26.537209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bc0edcef-60e3-4327-8e7f-b7293d6aabb9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28238 microversion: 2.20 time: 0.083981 Nov 19 19:54:26.538085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1620/3192] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:26 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:26.862501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:26.863162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:26.870776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:26.871235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:26.872011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:26.872437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:27.017272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:27.025220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fedf9efa-5427-4686-adb8-63d93d5ea6db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.168439 Nov 19 19:54:27.025788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1573/3193] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:27.551846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:27.552853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:27.560137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:27.560579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:27.561371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:27.561792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:27.640497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb6d045a-335a-465b-9e75-1dcc86dc20f1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28529 microversion: 2.20 time: 0.092563 Nov 19 19:54:27.641143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1621/3194] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:27 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28529 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:28.043170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:28.043814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:28.050493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:28.050944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:28.051723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:28.052152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:28.192656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:28.200748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6e485e8d-8a93-4872-a537-d902eedd9394 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.161298 Nov 19 19:54:28.201313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1574/3195] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:28.653109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:28.654034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:28.661593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:28.662011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:28.662817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:28.663241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:28.757900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6383f57f-975d-4f85-a213-dd27b104ff63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28697 microversion: 2.20 time: 0.108865 Nov 19 19:54:28.758607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1622/3196] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:28 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28697 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:29.219013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:29.219880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:29.227311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:29.227946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:29.228950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:29.229521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:29.380161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:29.392725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b04380f-79c9-4534-93c3-50deb547116d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.177567 Nov 19 19:54:29.393480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1575/3197] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:29.773258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:29.774316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:29.781631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:29.782133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:29.782888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:29.783314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:29.849263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2f44950e-22b3-4ce0-8b81-0ba81312d4c2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28697 microversion: 2.20 time: 0.081299 Nov 19 19:54:29.850066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1623/3198] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:29 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28697 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:30.414332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:30.414909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:30.421607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:30.422073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:30.422860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:30.423290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:30.564592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:30.577887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-98ffa805-3cf9-4b8b-8d52-08582d694a2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.167117 Nov 19 19:54:30.578763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1576/3199] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:30.862993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:30.863870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:30.871543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:30.871982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:30.872758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:30.873155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:30.942975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0bfda31b-3359-4be4-aedd-ef86773b9e58 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28697 microversion: 2.20 time: 0.083861 Nov 19 19:54:30.943995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1624/3200] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:30 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28697 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:31.597813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:31.598443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:31.604935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:31.605388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:31.606202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:31.606635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:31.752067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:31.761064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-05636c78-b500-427f-b4ff-2086a3f20cc9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166841 Nov 19 19:54:31.761564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1577/3201] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:31.955729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:31.956988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:31.965531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:31.965983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:31.966815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:31.967250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:32.057501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d02fc3a-e9ef-4c0c-b163-14c890de0f53 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 28815 microversion: 2.20 time: 0.105097 Nov 19 19:54:32.058269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1625/3202] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:31 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 28815 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:32.782597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:32.783410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:32.794590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:32.795279 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:32.796433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:32.797162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:32.942444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:32.951739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b1179bf-5c28-47fe-8230-ffbc8af62db2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.175200 Nov 19 19:54:32.952309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1578/3203] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:33.071721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:33.072666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:33.080021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:33.080470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:33.081262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:33.081687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:33.160412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-693bcfb5-6fd4-49cb-865f-87f7ee71f126 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 30953 microversion: 2.20 time: 0.093154 Nov 19 19:54:33.161081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1626/3204] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:33 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 30953 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:33.969937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:33.970545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:33.977290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:33.977731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:33.978549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:33.978967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:34.125959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:34.135965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6166870-029e-4775-a702-610a6885471d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.169756 Nov 19 19:54:34.136535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1579/3205] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:34.173762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:34.174760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:34.183240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:34.183714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:34.184533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:34.184966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:34.264432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e299ab2d-b8e3-4c12-a72d-be1480c9c6d4 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 32842 microversion: 2.20 time: 0.094664 Nov 19 19:54:34.265068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1627/3206] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:34 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 32842 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:35.154526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:35.155131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:35.161977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:35.162477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:35.163241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:35.163738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:35.277243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:35.278343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:35.286361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:35.286780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:35.287563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:35.288121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:35.344699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:35.354137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-166e45da-c41c-4cdb-b680-c946dcd820c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.203191 Nov 19 19:54:35.354784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1580/3207] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:35.370944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1e35c859-5976-4275-8bd0-aed050cdd0f0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 33859 microversion: 2.20 time: 0.097749 Nov 19 19:54:35.371619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1628/3208] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:35 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 33859 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Nov 19 19:54:36.372250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:36.372888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:36.380208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:36.380648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:36.381855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:36.382648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:36.384923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:36.386468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:36.394316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:36.395980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:36.395980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:36.395980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:36.506919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-11311d41-3f23-4504-9368-424edee5f776 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 34908 microversion: 2.20 time: 0.126487 Nov 19 19:54:36.507972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1629/3209] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:36 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 34908 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:36.530270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:36.539420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-68b8a6cd-5517-48f6-acd2-a3098a07eeae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.170899 Nov 19 19:54:36.539994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1581/3210] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:37.522841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:37.524128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:37.534956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:37.535586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:37.536787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:37.537321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:37.557349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:37.557971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:37.564642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:37.565110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:37.566478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:37.566971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:37.612465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b546aecf-d334-495d-9a42-13de5695454b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 36046 microversion: 2.20 time: 0.095665 Nov 19 19:54:37.616667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1630/3211] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:37 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 36046 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:37.707821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:37.716785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8d855e78-f97e-4f5d-a755-7fe8c83a5767 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.163834 Nov 19 19:54:37.720276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1582/3212] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:54:38.625789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:38.626813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:38.634800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:38.635276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:38.636123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:38.636591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:38.713215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-94c42bcb-a5fa-4855-b89c-a55aa32d0530 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 37757 microversion: 2.20 time: 0.091851 Nov 19 19:54:38.713867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1631/3213] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:38 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 37757 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:38.734742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:38.735323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:38.742374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:38.742818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:38.743594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:38.744019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:38.880697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:38.888990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52a9dcb6-86e2-4d01-9d3d-463db21130dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.157990 Nov 19 19:54:38.889564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1583/3214] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:38 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:39.727422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:39.728319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:39.735573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:39.736015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:39.736828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:39.737283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:39.812004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb88fa7c-2749-4909-9acb-073274b1a27c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 38255 microversion: 2.20 time: 0.089381 Nov 19 19:54:39.812726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1632/3215] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:39 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 38255 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:39.910197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:39.910857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:39.918317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:39.918776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:39.919857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:39.919999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:40.064110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:40.073938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2a081e6e-21ab-4383-9c9e-d8524922abcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.169546 Nov 19 19:54:40.074609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1584/3216] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:40.827188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:40.828268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:40.836986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:40.837432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:40.838278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:40.838706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:40.901984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-efd67a32-f766-4223-8e7b-18a957fc995a tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 38255 microversion: 2.20 time: 0.079573 Nov 19 19:54:40.903203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1633/3217] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:40 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 38255 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:41.096971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:41.097951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:41.105799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:41.106287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:41.107133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:41.107599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:41.270745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:41.281332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0dc395c-a38a-4935-9582-4721e0652d34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.188374 Nov 19 19:54:41.282086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1585/3218] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:54:41.915406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:41.916446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:41.924749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:41.924749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:41.925278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:41.925697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:41.991869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4911d54e-dcef-442a-8ec2-8951e1da3699 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 38255 microversion: 2.20 time: 0.080813 Nov 19 19:54:41.992530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1634/3219] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:41 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 38255 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:42.298912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:42.299547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:42.306330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:42.306782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:42.307556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:42.308062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:42.452726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:42.462153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8591f00a-e916-4d94-9b5e-2e8936525604 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166858 Nov 19 19:54:42.462711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1586/3220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:43.004655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:43.005683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:43.013354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:43.013809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:43.014643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:43.015081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:43.095715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8f88eda-40b7-4d61-b28c-54af16ef78cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 38308 microversion: 2.20 time: 0.095003 Nov 19 19:54:43.096525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1635/3221] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:42 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 38308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:43.481532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:43.482174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:43.488912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:43.489370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:43.490170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:43.490657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:43.640811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:43.649669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9df0b577-881f-4864-855d-c24219e89aaa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.172185 Nov 19 19:54:43.650300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1587/3222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:44.110123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:54:44.111724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:44.121089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:44.121979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:44.122336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:44.122771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:44.196370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e49761ae-9c8c-41a5-ac25-cd1ae4fddff0 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 200 len: 38398 microversion: 2.20 time: 0.090652 Nov 19 19:54:44.197406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1636/3223] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 19:54:44 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 38398 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:54:44.207327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:44.207815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:44.216579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:44.217092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:44.218295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:44.218873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:44.245095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e713fead-640a-4738-bc77-b2a05855864b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/ips" status: 200 len: 153 microversion: 2.20 time: 0.041468 Nov 19 19:54:44.245671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1588/3224] 10.222.0.46 () {60 vars in 1288 bytes} [Fri Nov 19 19:54:44 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:54:44.667276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:44.667937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:44.675375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:44.675822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:44.676655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:44.677086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:44.833993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:44.844464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43b3e56c-e098-4efc-9d3c-9bb91e967086 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.181235 Nov 19 19:54:44.845042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1637/3225] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:45.862390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:45.862995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:45.869674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:45.870132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:45.870919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:45.871306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:46.005319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:46.013434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-acc8bc16-02ce-4268-9aec-03a73279ebfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.154770 Nov 19 19:54:46.014000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1589/3226] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:47.031290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:47.031972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:47.039410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:47.039864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:47.040666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:47.041096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:47.182084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:47.190737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-57659b71-926d-49d6-9125-71388a16bc1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.163144 Nov 19 19:54:47.191317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1638/3227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:47 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:48.209204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:48.210709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:48.218290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:48.218753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:48.219612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:48.220031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:48.361484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:48.369179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9064c1e-6916-4553-b39f-aa5f85a31511 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.163739 Nov 19 19:54:48.374576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1590/3228] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:48 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:49.386573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:49.387247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:49.393908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:49.394762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:49.395543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:49.396140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:49.539474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:49.549155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-22dc1a72-d818-4d6a-9d96-8b1a2beee648 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.166248 Nov 19 19:54:49.549757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1639/3229] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:49 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:50.570142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:50.570790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:50.577510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:50.577955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:50.578786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:50.579220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:50.725072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:50.733685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7c32e96e-79ce-4a95-90ad-b54ae37f2a48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.167936 Nov 19 19:54:50.734307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1591/3230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:50 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:51.751030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:51.751694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:51.758575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:51.759093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:51.759928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:51.760352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:51.899892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:51.908082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6f036354-876d-45a1-b55f-b8af71d641c8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.160763 Nov 19 19:54:51.908654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1640/3231] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:51 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:52.924728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:52.925344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:52.932182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:52.932621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:52.933410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:52.933840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:53.071208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:53.080122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ea5ad197-f743-4312-9e93-acc92378b57b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.159037 Nov 19 19:54:53.080700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1592/3232] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:52 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:54.099082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:54.099717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:54.107061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:54.107510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:54.108290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:54.108719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:54.255300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:54.265259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bd7a2bc8-2dcc-4282-8e27-a08b6bf901be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.169775 Nov 19 19:54:54.265860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1641/3233] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:55.283178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:55.284199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:55.293841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:55.294513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:55.295570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:55.296168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:55.447452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:55.456097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5f784ddf-708a-4944-8d2e-c7a2b15e64be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.176630 Nov 19 19:54:55.456598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1593/3234] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:55 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:56.474783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:56.475535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:56.482449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:56.482894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:56.483707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:56.484132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:56.625048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:56.633507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-87ea3736-68b8-4f64-8154-e2c4e921409a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.162551 Nov 19 19:54:56.634105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1642/3235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:56 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:57.652079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:57.652744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:57.659725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:57.660174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:57.660964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:57.661402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:57.808643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:57.819137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e88c8bb-2333-4989-b71f-8abb990deea4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.171016 Nov 19 19:54:57.819725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1594/3236] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:57 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:54:58.839074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:54:58.839760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:54:58.847024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:58.847472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:58.848260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:54:58.848691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:54:59.006028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:54:59.015166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-73b32c0c-c122-4e05-bc8f-2d6db0e998d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.179956 Nov 19 19:54:59.015880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1643/3237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:54:58 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:00.036887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:00.037564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:00.045190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:00.045640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:00.046479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:00.046896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:00.186721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:00.198971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-72b75187-d518-4b7c-a214-d79becd9aa35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165871 Nov 19 19:55:00.199552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1595/3238] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:00 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:01.217266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:01.217843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:01.224742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:01.225185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:01.225960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:01.226434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:01.369959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:01.378319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-40415191-f3b0-4dda-a7cb-a03395406e48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165352 Nov 19 19:55:01.378906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1644/3239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:01 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:02.401194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:02.401881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:02.408219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:02.408671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:02.409455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:02.409899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:02.548139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:02.556151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b29b617e-6fce-402d-907c-1f9c4882fd24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.158848 Nov 19 19:55:02.556731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1596/3240] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:02 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:03.574394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:03.574988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:03.581956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:03.582429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:03.583282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:03.583743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:03.725204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:03.735235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1bfe3ac5-3aa3-4469-b504-a8a7f1f3aa7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.165080 Nov 19 19:55:03.735844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1645/3241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:03 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:04.753483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:04.754451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:04.760697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:04.761158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:04.761908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:04.762468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:04.898719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:04.908066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c468bccd-1299-475f-ac69-e239ebb06117 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.158254 Nov 19 19:55:04.908636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1597/3242] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:04 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:05.927036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:05.927744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:05.934525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:05.934969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:05.935736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:05.936160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:06.081393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:06.090950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9470231b-2611-45c8-84ec-7ca555edfd33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.167950 Nov 19 19:55:06.091541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1646/3243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:05 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:07.108985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:07.109668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:07.117424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:07.117853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:07.118916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:07.119353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:07.506630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:07.515406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ca8eb00e-aba7-4378-86bf-fcca51a36e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.410186 Nov 19 19:55:07.515981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1598/3244] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:07 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:08.535024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:08.535694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:08.543380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:08.543826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:08.544611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:08.545039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:08.685439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:08.694232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d946c2a-aa09-4908-8165-fece6dc4f486 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.164514 Nov 19 19:55:08.694807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1647/3245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:08 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:09.712024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:09.712666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:09.720518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:09.720962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:09.721716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:09.722199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:09.904195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:09.912579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5d5e472-9a53-4b2a-9fea-3418caf87dc7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.204435 Nov 19 19:55:09.913173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1599/3246] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:09 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:10.930958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:10.931619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:10.938594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:10.939044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:10.939831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:10.940261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:11.082836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:11.091869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b160cd72-a0b6-4f34-b10e-4326c0764d23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.164811 Nov 19 19:55:11.092452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1648/3247] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:10 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:11.541174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:11.541774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:11.548649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:11.549092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:11.549858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:11.550313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:11.575679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:55:11.664659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a61937be-1d01-4f4a-86d4-30a90b9dcf51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 204 len: 0 microversion: 2.1 time: 0.126238 Nov 19 19:55:11.665622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1600/3248] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:55:11 2021] DELETE /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:55:11.674022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:11.674658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:11.680975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:11.681415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:11.682237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:11.682663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:11.851175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:11.862646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0423ddf7-d779-4003-a722-99ddf4d9cfd8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1507 microversion: 2.1 time: 0.192306 Nov 19 19:55:11.863364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1649/3249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:11 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:12.116147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:12.116858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:12.123437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:12.123865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:12.124689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:12.125102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:12.359678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:12.369968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-524dc31c-f140-4735-a94b-562d063fdffc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.262063 Nov 19 19:55:12.370510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1601/3250] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:12 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:55:12.872775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-1fea1c33-8738-4374-a5bb-b7e0f4c8ab3a req-c854a384-dd62-44bc-8f57-4d204298680e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d879d4cd-e7fb-4405-a218-e89955a7405c", "name": "network-vif-deleted", "tag": "512afcb1-3817-4353-9942-5484dcaeeb5f"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:12.875263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:55:12.875263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:55:12.883102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-1fea1c33-8738-4374-a5bb-b7e0f4c8ab3a req-c854a384-dd62-44bc-8f57-4d204298680e service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:12.885124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:12.885647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:12.885918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-1fea1c33-8738-4374-a5bb-b7e0f4c8ab3a req-c854a384-dd62-44bc-8f57-4d204298680e service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:12.892868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:12.893741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:12.894746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:12.895189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:12.900630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-1fea1c33-8738-4374-a5bb-b7e0f4c8ab3a req-c854a384-dd62-44bc-8f57-4d204298680e service nova] Creating event network-vif-deleted:512afcb1-3817-4353-9942-5484dcaeeb5f for instance d879d4cd-e7fb-4405-a218-e89955a7405c on hv-cinder-77703 Nov 19 19:55:12.907824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-1fea1c33-8738-4374-a5bb-b7e0f4c8ab3a req-c854a384-dd62-44bc-8f57-4d204298680e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113506 Nov 19 19:55:12.908476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1650/3251] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:55:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:55:12.938832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:12.939299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:12.939849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lazy-loading 'fault' on Instance uuid d879d4cd-e7fb-4405-a218-e89955a7405c {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:55:12.988782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:12.997651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56211432-8850-46a6-adaf-cd0c65beb82f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 200 len: 1311 microversion: 2.1 time: 0.116741 Nov 19 19:55:12.998083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1602/3252] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:12 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 1311 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:55:13.389301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:13.390453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:13.397177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:13.397591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:13.398398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:13.399063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:13.672210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:13.680930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-12f0946b-192a-4166-ad4b-9e9bf19cebf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1719 microversion: 2.1 time: 0.296183 Nov 19 19:55:13.681577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1651/3253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:13 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1719 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:14.022033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:14.022803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: d879d4cd-e7fb-4405-a218-e89955a7405c] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:14.030547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.031653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.031816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.032207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.047505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] HTTP exception thrown: Instance d879d4cd-e7fb-4405-a218-e89955a7405c could not be found. Nov 19 19:55:14.048460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Returning 404 to user: Instance d879d4cd-e7fb-4405-a218-e89955a7405c could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:55:14.049330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f7b101a5-31e5-40cb-8f20-1aa824d23160 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c" status: 404 len: 111 microversion: 2.1 time: 0.032630 Nov 19 19:55:14.053440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1603/3254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:14 2021] GET /compute/v2.1/servers/d879d4cd-e7fb-4405-a218-e89955a7405c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:55:14.058869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:14.059640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:14.066425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.066872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.067676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.068111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.113254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:55:14.236680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b2294883-222e-4eb2-848a-86cc0f0c29a4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "DELETE /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 204 len: 0 microversion: 2.1 time: 0.180403 Nov 19 19:55:14.238205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1652/3255] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:55:14 2021] DELETE /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:55:14.247694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:14.248518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:14.255678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.256593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.256890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.257656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.412971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:14.421676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-916a2111-ce17-458d-a12d-be16c046a28f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1567 microversion: 2.1 time: 0.178514 Nov 19 19:55:14.422295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1604/3256] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:14.699158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:14.700187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:14.706469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.707062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.707943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.708487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.785310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:14.796517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a1e8d973-7965-4f9a-bca0-117dcd803a87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.101396 Nov 19 19:55:14.797504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1653/3257] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:14 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:14.924047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-f4e2e373-d6dc-46f5-8828-9608c8fe3b3b req-d45cfb52-9769-41b4-be0b-872bc69fdf3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c95be893-491f-4bf9-aa24-491855918b26", "name": "network-vif-deleted", "tag": "0eeb739f-3a4a-49e6-9ded-a5fbec042e1f"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:14.928596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:55:14.928596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:55:14.940354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-f4e2e373-d6dc-46f5-8828-9608c8fe3b3b req-d45cfb52-9769-41b4-be0b-872bc69fdf3f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:14.942152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-f4e2e373-d6dc-46f5-8828-9608c8fe3b3b req-d45cfb52-9769-41b4-be0b-872bc69fdf3f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:14.957229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-f4e2e373-d6dc-46f5-8828-9608c8fe3b3b req-d45cfb52-9769-41b4-be0b-872bc69fdf3f service nova] Creating event network-vif-deleted:0eeb739f-3a4a-49e6-9ded-a5fbec042e1f for instance c95be893-491f-4bf9-aa24-491855918b26 on hv-cinder-77703 Nov 19 19:55:14.964049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-f4e2e373-d6dc-46f5-8828-9608c8fe3b3b req-d45cfb52-9769-41b4-be0b-872bc69fdf3f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044932 Nov 19 19:55:14.966383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1605/3258] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:55:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:55:15.443929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:15.444756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:15.453422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:15.454207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:15.455034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:15.455489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:15.551379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:15.563540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-029b63ef-0cfc-4de6-a144-cf91d0a6ad77 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.126113 Nov 19 19:55:15.564073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1654/3259] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:55:15.815104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:15.815839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:15.822448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:15.822901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:15.823694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:15.824196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:15.895530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:15.903838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-122f87db-b494-4f12-97b9-94867dc34786 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.093349 Nov 19 19:55:15.904417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1606/3260] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:15 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:16.581114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:16.581727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:16.588544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:16.588994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:16.590937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:16.591377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:16.660514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:16.669377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-55a1086f-079a-447f-889f-0436d8565b31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092139 Nov 19 19:55:16.669978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1655/3261] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:16.921921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:16.922713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:16.929686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:16.930360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:16.931338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:16.931776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:17.006100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:17.008678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-d7949c26-ff98-4149-87bc-3a5ecc764eaa req-4f05bed8-491b-4f8a-94cf-b5a5ce8414ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38904995-d04e-4db1-93b4-52153ee2c2e2", "name": "network-vif-deleted", "tag": "610b92c9-51b5-4f46-ae92-d11988ba413e"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:17.010343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:55:17.010343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:55:17.015485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-096fee75-bcc7-4dbe-8722-cb3bdd4c8e42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.097728 Nov 19 19:55:17.016222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1607/3262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:16 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:17.018313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-d7949c26-ff98-4149-87bc-3a5ecc764eaa req-4f05bed8-491b-4f8a-94cf-b5a5ce8414ff service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:17.018762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-d7949c26-ff98-4149-87bc-3a5ecc764eaa req-4f05bed8-491b-4f8a-94cf-b5a5ce8414ff service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:17.031392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-d7949c26-ff98-4149-87bc-3a5ecc764eaa req-4f05bed8-491b-4f8a-94cf-b5a5ce8414ff service nova] Creating event network-vif-deleted:610b92c9-51b5-4f46-ae92-d11988ba413e for instance 38904995-d04e-4db1-93b4-52153ee2c2e2 on hv-cinder-77703 Nov 19 19:55:17.037909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-d7949c26-ff98-4149-87bc-3a5ecc764eaa req-4f05bed8-491b-4f8a-94cf-b5a5ce8414ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032891 Nov 19 19:55:17.038704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1656/3263] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:55:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:55:17.689805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:17.690644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:17.699291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:17.699862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:17.701029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:17.701645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:17.769286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:17.780542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c165b963-0cdb-4235-b9a9-9b9b456a08eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097021 Nov 19 19:55:17.781110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1608/3264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:55:18.034290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:18.034973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:18.041901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:18.042382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:18.043164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:18.043800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:18.119278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:18.128304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7bd267cd-612a-4e09-a765-9fb72a869819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.098648 Nov 19 19:55:18.128863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1657/3265] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:18 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:18.797074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:18.797682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:18.804491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:18.804943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:18.805697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:18.806150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:18.870810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:18.879665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-269c14cc-fa37-4c91-a349-23eb80b2a7af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086409 Nov 19 19:55:18.880226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1609/3266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:19.148063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:19.148916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:19.157310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:19.157764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:19.158568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:19.159001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:19.223746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:19.231722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-37c3bd97-41f1-4e2d-be0b-927906f9f4c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.089582 Nov 19 19:55:19.232265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1658/3267] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:19 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:19.898784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:19.899626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:19.907443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:19.907886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:19.908657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:19.909081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:19.970996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:19.979311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5191b46d-9821-41b1-b692-158bfc76e7cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086130 Nov 19 19:55:19.980134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1610/3268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:20.249171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:20.249922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:20.256848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:20.257290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:20.258084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:20.258521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:20.320951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:20.329532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ad6a0acd-ec42-416c-b295-2c922f61ac8b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.084349 Nov 19 19:55:20.330146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1659/3269] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:20 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:20.996530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:20.997223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:21.004022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:21.004444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:21.005234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:21.005662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:21.067639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:21.076725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a5b82977-de35-436e-840c-11c2bb02fa6f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083969 Nov 19 19:55:21.077300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1611/3270] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:21.355050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:21.355763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:21.363442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:21.363890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:21.364675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:21.365104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:21.432114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:21.443921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d531d7a-b76c-407f-bd7d-a5548c8a89be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.092310 Nov 19 19:55:21.444824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1660/3271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:21 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:22.095476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:22.096112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:22.103084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:22.103559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:22.104363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:22.104800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:22.171354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:22.179763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f77e3b44-1daf-436e-8243-c1342572b189 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087998 Nov 19 19:55:22.180439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1612/3272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:22.468033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:22.468595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:22.475444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:22.475917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:22.476668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:22.477095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:22.557799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:22.569479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7f7f338d-a46c-4b06-a15a-9e23a51cc423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.105786 Nov 19 19:55:22.570162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1661/3273] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:22 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:23.197153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:23.197757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:23.205061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:23.205541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:23.206364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:23.206788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:23.279321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:23.287599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2a3b513b-e3eb-45e8-a19c-6f4761dfdee0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094171 Nov 19 19:55:23.288129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1613/3274] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:23.588757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:23.589387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:23.596950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:23.597401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:23.598198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:23.598630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:23.661069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:23.670298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-87a006d6-6d2d-4d85-bb31-1593d9471824 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.085451 Nov 19 19:55:23.670872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1662/3275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:23 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:24.307607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:24.308357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:24.315732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:24.316181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:24.316934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:24.317373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:24.383925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:24.392635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1dc36fe3-12bf-4e44-87b7-9d559158c919 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091275 Nov 19 19:55:24.393217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1614/3276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:24.688523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:24.689133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:24.699453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:24.700035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:24.701238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:24.701719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:24.769051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:24.777241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ade319ef-a670-46ad-8a87-953455b3e158 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.093187 Nov 19 19:55:24.777778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1663/3277] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:24 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:25.408853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:25.409650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:25.416008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:25.416456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:25.417218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:25.417646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:25.488441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:25.501476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4bbceeef-c849-43a2-adaf-bd9aad768060 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096167 Nov 19 19:55:25.502304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1615/3278] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:25.794358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:25.795027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:25.801757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:25.802239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:25.803094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:25.803521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:25.867993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:25.875818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-05f2194d-4853-4447-a487-92da2f65d1ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.085190 Nov 19 19:55:25.876770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1664/3279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:25 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:26.520828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:26.521384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:26.530738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:26.531261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:26.532658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:26.533177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:26.595420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:26.607128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46ecba3d-12fc-401e-be6d-602d6c031356 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092010 Nov 19 19:55:26.607828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1616/3280] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:26.898621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:26.899232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:26.906010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:26.906567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:26.907716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:26.908143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:26.977030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:26.985161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e7bd0f1b-fb4e-4016-b819-1a1f5f21146c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.090343 Nov 19 19:55:26.985845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1665/3281] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:26 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:27.624470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:27.625080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:27.631784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:27.632229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:27.632991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:27.633419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:27.698903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:27.708557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-281f2155-8a8a-4e02-a281-53b12de14dad tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087936 Nov 19 19:55:27.709164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1617/3282] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:28.007919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:28.008711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:28.017293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:28.018157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:28.019451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:28.019976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:28.106512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:28.115540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8316bb3-9ce3-4363-ad86-e27beffe3a16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.112185 Nov 19 19:55:28.116110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1666/3283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:28 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:28.727109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:28.727775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:28.735101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:28.735616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:28.736656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:28.737151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:28.802022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:28.810726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76395d9f-7133-4fd1-9386-3b90daf5a11c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087752 Nov 19 19:55:28.811288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1618/3284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:29.133812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:29.134580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:29.141791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:29.142375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:29.143212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:29.143611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:29.208797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:29.217525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8b87a7b-26f0-4d0b-b7a2-e501f0896605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.087365 Nov 19 19:55:29.218127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1667/3285] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:29 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:29.827866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:29.828497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:29.835474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:29.835927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:29.836699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:29.837136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:29.907044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:29.919635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1b7fc835-701a-4b40-9033-e9ea0e0c316d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095124 Nov 19 19:55:29.920408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1619/3286] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:30.237419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:30.238073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:30.247275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:30.247845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:30.254526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:30.254526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:30.325650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:30.334077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-64a1a3de-4a73-4b4b-8659-66f8fb5cabdf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.102420 Nov 19 19:55:30.334672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1668/3287] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:30 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:30.940767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:30.941411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:30.948223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:30.948677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:30.949455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:30.949897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:31.019040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:31.031258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d45165e-f3fb-4bca-974b-5d797afc195d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095509 Nov 19 19:55:31.032198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1620/3288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:31.352885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:31.353494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:31.360378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:31.360828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:31.361676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:31.362147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:31.427593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:31.436162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc201ae8-fef4-41c0-9cd7-93d2e7a52938 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.087005 Nov 19 19:55:31.436741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1669/3289] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:31 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:32.050202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:32.050851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:32.057639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:32.058080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:32.058880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:32.059313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:32.131905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:32.140322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6628fa15-de57-4c55-b9ed-4da4090d9ccc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094987 Nov 19 19:55:32.140869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1621/3290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:32.453558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:32.454194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:32.461275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:32.461749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:32.462556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:32.462986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:32.534275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:32.542826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-53a36b76-0f29-4f73-87cb-6b060cf5c733 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.093179 Nov 19 19:55:32.543399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1670/3291] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:32 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:33.112859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:55:33.113528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:55:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:55:33.156746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:33.157341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:33.163862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:33.164316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:33.165085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:33.165513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:33.228418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:33.236549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cf21d7e5-e209-4976-b29e-ac56114ae707 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083646 Nov 19 19:55:33.237128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1622/3292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:33.560310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:33.560945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:33.567727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:33.568172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:33.568935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:33.569359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:33.633896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:33.641942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-469403e3-833f-4412-acde-d625b343b21c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.085665 Nov 19 19:55:33.642544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1671/3293] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:33 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:34.255577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:34.256160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:34.265928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:34.266617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:34.267766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:34.268459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:34.347191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:34.355737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1f62ba33-2df0-49e5-b8bc-29f2a968dda0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.105675 Nov 19 19:55:34.356316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1623/3294] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:34.660490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:34.661074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:34.667703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:34.668147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:34.668905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:34.669329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:34.738024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:34.750081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2eb2b2ed-546f-45d3-888c-b980127069e8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.093769 Nov 19 19:55:34.750929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1672/3295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:34 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:35.375574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:35.376227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:35.383680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:35.384128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:35.384886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:35.385315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:35.459936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:35.468617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1c481e44-7371-47fe-9e3e-8aa335b90c63 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.098337 Nov 19 19:55:35.469210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1624/3296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:35.769205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:35.769895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:35.776768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:35.777213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:35.777977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:35.778435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:35.846902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:35.855600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7008a945-357a-4433-ad25-4f4cf8645af6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.090981 Nov 19 19:55:35.856170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1673/3297] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:35 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:36.488689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:36.489337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:36.496071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:36.496521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:36.497301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:36.497730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:36.565483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:36.574190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-753411c8-bb04-4497-b504-077846dc35e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090881 Nov 19 19:55:36.574752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1625/3298] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:36.878159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:36.878916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:36.885109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:36.885550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:36.886355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:36.886782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:36.948167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:36.956733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f69c17f-4e61-4237-857f-784999c708e6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.084939 Nov 19 19:55:36.957305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1674/3299] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:36 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:37.591766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:37.592373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:37.599154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:37.599596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:37.600367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:37.600788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:37.662023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:37.670189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f0b14de7-63a6-494f-9e8f-e54ba9ea6950 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.082571 Nov 19 19:55:37.670734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1626/3300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:37.974779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:37.975462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:37.982370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:37.982810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:37.983585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:37.984067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:38.057641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:38.065795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e356302c-6bf3-4f18-ace2-ef6c7634f90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.094810 Nov 19 19:55:38.066396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1675/3301] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:37 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:38.687508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:38.688163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:38.695612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:38.696071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:38.696904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:38.697392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:38.770277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:38.781125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4fa6ce58-a947-4a72-b4cb-36d8ed2428d6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097677 Nov 19 19:55:38.781839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1627/3302] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:39.084668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:39.085279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:39.092232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:39.092679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:39.093451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:39.093883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:39.163752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:39.173022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-66c26d70-fa4c-4549-bb5b-86383d266ca6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.092659 Nov 19 19:55:39.173588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1676/3303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:39 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:39.798521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:39.799155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:39.806081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:39.806564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:39.807337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:39.807785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:39.872324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:39.882342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-972638be-a012-483b-bf9e-65d625a63a2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087445 Nov 19 19:55:39.882915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1628/3304] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:40.191316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:40.191887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:40.198433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:40.198885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:40.199688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:40.200116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:40.266077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:40.275138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c00d38d1-81dc-453e-ac30-7638083068f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.088167 Nov 19 19:55:40.275739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1677/3305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:40 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:40.903475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:40.904103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:40.914934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:40.915525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:40.916641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:40.917237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:40.984612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:40.993793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7aab27a9-ca9f-4721-ab9f-fa6373d76b46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096211 Nov 19 19:55:40.994416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1629/3306] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:41.292322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:41.292928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:41.300015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:41.300489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:41.301285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:41.301696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:41.369868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:41.380530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5952d02-2fcf-4b77-8d31-800be3c9f052 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.091963 Nov 19 19:55:41.381105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1678/3307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:41 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:42.014171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:42.015059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:42.025739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:42.026249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:42.027033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:42.027488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:42.094803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:42.103128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d190946b-a41f-4c3e-8766-0a05b0853c91 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094990 Nov 19 19:55:42.103713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1630/3308] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:42.398911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:42.399506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:42.406296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:42.406718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:42.407496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:42.407929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:42.476313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:42.488414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-21e709c1-6606-4785-9e49-cf70968a869e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.093448 Nov 19 19:55:42.488996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1679/3309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:42 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:43.120194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:43.120853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:43.128754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:43.129278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:43.130250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:43.130754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:43.196968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:43.208626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-610a410f-e3f2-4a6d-b569-e994a7d21e61 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092746 Nov 19 19:55:43.209235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1631/3310] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:43.512616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:43.513223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:43.520913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:43.521361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:43.522180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:43.522614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:43.585761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:43.594327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-93f59955-6aad-49c9-a95f-b0df2e565bb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.085643 Nov 19 19:55:43.594888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1680/3311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:43 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:44.225988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:44.226664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:44.233335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:44.233775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:44.234575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:44.234998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:44.302848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:44.315905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c03ff732-48c2-4311-96a3-a7a739c54cd5 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093304 Nov 19 19:55:44.316505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1632/3312] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:44.613977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:44.614600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:44.621269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:44.621711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:44.622506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:44.622931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:44.686725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:44.695647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bd89326e-76b9-4351-92f4-a50498509505 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.086617 Nov 19 19:55:44.696214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1681/3313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:44 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:45.334380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:45.335102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:45.344553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:45.345153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:45.346078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:45.346800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:45.411346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:45.419383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e892caa-a5d9-44a2-a6c5-7f9bcd1280e3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090136 Nov 19 19:55:45.419941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1633/3314] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:45.713199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:45.713893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:45.721038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:45.721479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:45.722271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:45.722701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:45.790625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:45.799228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7d53adcd-7668-4f0b-9805-161dfbce0edd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.089801 Nov 19 19:55:45.799808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1682/3315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:45 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:46.438916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:46.439547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:46.449614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:46.450152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:46.451188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:46.451836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:46.516254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:46.524503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f5ab4b2-b19d-47b9-bf94-add0dbd5a4f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089872 Nov 19 19:55:46.525073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1634/3316] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:46.819053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:46.819652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:46.826218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:46.826667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:46.827428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:46.827855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:46.890775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:46.899133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3822a0ad-f59a-4602-967c-1576a2a201fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 200 len: 1368 microversion: 2.1 time: 0.085009 Nov 19 19:55:46.899672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1683/3317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:46 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 1368 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:46.916228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e99a010-c3c3-42d6-ae61-5f6f28c3c095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '.version_select at 0x7fc14caabdc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:46.945633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e99a010-c3c3-42d6-ae61-5f6f28c3c095 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742200303" status: 202 len: 0 microversion: 2.1 time: 0.032482 Nov 19 19:55:46.946665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1635/3318] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Nov 19 19:55:46 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742200303 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 19:55:47.541443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:47.542072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:47.548043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:47.548494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:47.549256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:47.549698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:47.611905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:47.620579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2ac40635-214b-4458-aa3f-463a14ae802b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083071 Nov 19 19:55:47.621155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1684/3319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:47.759422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-45fc8598-1691-4665-b719-404c2d1cef3a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: .version_select at 0x7fc14cadaca0>, body: {"keypair": {"name": "tempest-keypair-2015026434"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:47.775228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-45fc8598-1691-4665-b719-404c2d1cef3a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:55:47.779247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-45fc8598-1691-4665-b719-404c2d1cef3a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for user ce68124c60ff4f6a820dc3a04630663a and project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:55:47.915092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-45fc8598-1691-4665-b719-404c2d1cef3a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:55:47.920295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-45fc8598-1691-4665-b719-404c2d1cef3a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for user ce68124c60ff4f6a820dc3a04630663a and project f6c9eacf55bb437da4631e3110651320. Resources: {'key_pairs'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:55:47.934972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-45fc8598-1691-4665-b719-404c2d1cef3a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.179836 Nov 19 19:55:47.935547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1636/3320] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Nov 19 19:55:47 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:48.638374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:48.639016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:48.646392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:48.646834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:48.647608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:48.648031 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:48.708540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:48.716973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-41f55c3b-2814-43e3-a7b4-993d9f6461ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.082307 Nov 19 19:55:48.717629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1685/3321] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:49.221710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1834758936", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2006e30f-6f7d-4222-b3ea-0cb7cc3e862e"}], "security_groups": [{"name": "tempest-securitygroup--762694329"}], "key_name": "tempest-keypair-2015026434", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:49.328672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] validate_networks() for [('2006e30f-6f7d-4222-b3ea-0cb7cc3e862e', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 19:55:49.735167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:49.735809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:49.742831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:49.743274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:49.744082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:49.744476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:49.798133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 19:55:49.798524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 19:55:49.799020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 19:55:49.799428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 19:55:49.799834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 19:55:49.809547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:49.809991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:49.810839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:49.811271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:49.816440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:49.824541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e523eac-ec06-4c1e-8caf-a1a40cb8e82c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093120 Nov 19 19:55:49.825120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1686/3322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:55:49.828581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for project f6c9eacf55bb437da4631e3110651320. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 19:55:49.832831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Getting quotas for user ce68124c60ff4f6a820dc3a04630663a and project f6c9eacf55bb437da4631e3110651320. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 19:55:49.844620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 19:55:49.847119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 19:55:49.895054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ac9740d1-6f74-453e-90c4-feec0326cf76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.677481 Nov 19 19:55:49.895818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1637/3323] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 19:55:49 2021] POST /compute/v2.1/servers => generated 401 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 19:55:49.905764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d7ebb61c-6c83-4584-b448-4983e297a30e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:49.906435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d7ebb61c-6c83-4584-b448-4983e297a30e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:49.958838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d7ebb61c-6c83-4584-b448-4983e297a30e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:49.965925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d7ebb61c-6c83-4584-b448-4983e297a30e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1238 microversion: 2.1 time: 0.063860 Nov 19 19:55:49.966530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1687/3324] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1238 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:50.842230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:50.842862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:50.851525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:50.852115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:50.853325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:50.853893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:50.951134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:50.961980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4076505c-f697-4289-bf33-04d7455df9cd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.124146 Nov 19 19:55:50.963045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1638/3325] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:50.983764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:50.984400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:50.991270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:50.991727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:50.992514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:50.993157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:51.063087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:51.071971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b3b4b1c3-8ca1-4b70-a249-0a6b343dcbc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1296 microversion: 2.1 time: 0.092133 Nov 19 19:55:51.072613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1688/3326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:51.979537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:51.980139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:51.991447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:51.992444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:51.993216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:51.993640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:52.065216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:52.073573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a81f514c-ef6a-4434-bd9c-c1de447cc5ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097810 Nov 19 19:55:52.074190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1639/3327] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:52.089528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:52.090519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:52.096808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:52.097596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:52.098400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:52.098830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:52.352236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:52.360129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-afa68482-c598-48d7-a17f-85859cd57fa3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1363 microversion: 2.1 time: 0.274101 Nov 19 19:55:52.360888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1689/3328] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:52.689903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-dc42d387-d32e-4ef4-af1f-51e192a19e6f req-33a7e2b7-9d0b-4571-8966-0e12719595cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9233030-c878-4eef-a231-13ba34eae0c2", "tag": "098b2daa-b628-41ee-b4c2-112143fa0d32"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:52.691842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:55:52.691842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:55:52.701641 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-dc42d387-d32e-4ef4-af1f-51e192a19e6f req-33a7e2b7-9d0b-4571-8966-0e12719595cf service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:52.722557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-dc42d387-d32e-4ef4-af1f-51e192a19e6f req-33a7e2b7-9d0b-4571-8966-0e12719595cf service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:52.735555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-dc42d387-d32e-4ef4-af1f-51e192a19e6f req-33a7e2b7-9d0b-4571-8966-0e12719595cf service nova] Creating event network-changed:098b2daa-b628-41ee-b4c2-112143fa0d32 for instance e9233030-c878-4eef-a231-13ba34eae0c2 on hv-cinder-77703 Nov 19 19:55:52.741475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-dc42d387-d32e-4ef4-af1f-51e192a19e6f req-33a7e2b7-9d0b-4571-8966-0e12719595cf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055815 Nov 19 19:55:52.742104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1640/3329] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:55:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:55:53.091751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:53.092387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:53.099724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:53.100179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:53.100959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:53.101377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:53.165704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:53.174699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6bd7d5ec-c38e-46b6-afa6-dd4930a2d9f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086555 Nov 19 19:55:53.175376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1690/3330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:53.380305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:53.381017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:53.387984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:53.388331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:53.389307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:53.389738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:53.627776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:53.635387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-37fc45b9-e678-4898-a94a-b860a72a2f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1363 microversion: 2.1 time: 0.260551 Nov 19 19:55:53.635953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1641/3331] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1363 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:54.200327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:54.201167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:54.208087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:54.208535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:54.209314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:54.209876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:54.290075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:54.301974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e7619cec-b873-4bd6-9696-be2128225926 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.107953 Nov 19 19:55:54.302704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1691/3332] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:54.652274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:54.652911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:54.659627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:54.660069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:54.660830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:54.661257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:54.816949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:54.825206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f30541bb-9c62-4ae5-ac7a-2d9ac030fb40 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1363 microversion: 2.1 time: 0.176655 Nov 19 19:55:54.825794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1642/3333] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:55.323363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:55.324045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:55.330858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:55.331386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:55.332500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:55.332933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:55.404182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:55.412807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3604d1cd-cb56-4d94-bf66-48e320838619 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093351 Nov 19 19:55:55.413379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1692/3334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:55.843553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:55.844120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:55.851339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:55.851789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:55.852557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:55.852986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:55.996552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:56.007244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ff4d9a7-968d-453c-8c94-1e05a3fff530 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1363 microversion: 2.1 time: 0.167560 Nov 19 19:55:56.008056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1643/3335] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:56.429965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:56.430629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:56.438204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:56.438648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:56.439419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:56.439844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:56.510532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:56.519391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-15d02a9c-33f2-4959-8c7a-4210ce350d0f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093069 Nov 19 19:55:56.520008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1693/3336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:57.028426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:57.029074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:57.036159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:57.036613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:57.037426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:57.037838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:57.185842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:57.195624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-83e8cd9e-96d6-4dd7-a5f0-39f59e0a39c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1363 microversion: 2.1 time: 0.170876 Nov 19 19:55:57.196202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1644/3337] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:57.536741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:57.537383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:57.544067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:57.544440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:57.545200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:57.545619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:57.607701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:57.616967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ec87311-dd15-46eb-ae85-efa1f5e1d429 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084059 Nov 19 19:55:57.617510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1694/3338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:57.862419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-faf4f820-aa26-42f5-a42f-f9375c96d3e2 req-62c43f6a-ca69-4c29-8d4b-aa337b5e8d1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9233030-c878-4eef-a231-13ba34eae0c2", "name": "network-vif-plugged", "status": "completed", "tag": "098b2daa-b628-41ee-b4c2-112143fa0d32"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:55:57.863817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:55:57.863817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:55:57.872909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-faf4f820-aa26-42f5-a42f-f9375c96d3e2 req-62c43f6a-ca69-4c29-8d4b-aa337b5e8d1a service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:57.873570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-faf4f820-aa26-42f5-a42f-f9375c96d3e2 req-62c43f6a-ca69-4c29-8d4b-aa337b5e8d1a service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:57.885210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-faf4f820-aa26-42f5-a42f-f9375c96d3e2 req-62c43f6a-ca69-4c29-8d4b-aa337b5e8d1a service nova] Creating event network-vif-plugged:098b2daa-b628-41ee-b4c2-112143fa0d32 for instance e9233030-c878-4eef-a231-13ba34eae0c2 on hv-cinder-77703 Nov 19 19:55:57.890370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-faf4f820-aa26-42f5-a42f-f9375c96d3e2 req-62c43f6a-ca69-4c29-8d4b-aa337b5e8d1a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Nov 19 19:55:57.890973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1645/3339] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:55:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:55:58.213158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:58.213758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:58.220689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:58.221134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:58.221905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:58.222361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:58.365845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:58.376336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1c81ee14-b293-425c-a6c6-d1272a78d585 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1363 microversion: 2.1 time: 0.166898 Nov 19 19:55:58.377070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1695/3340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:58.636261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:58.636846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:58.644497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:58.644952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:58.645724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:58.646202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:58.715459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:58.723887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-917c6b4a-a3db-4b81-bbde-7aa31606bb3a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092862 Nov 19 19:55:58.724582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1646/3341] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:59.393093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:59.393709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:59.400319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:59.400761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:59.401525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:59.401952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:59.540476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:59.549266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7445d916-4c94-49b8-a2f3-4db7a02eb094 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1548 microversion: 2.1 time: 0.159523 Nov 19 19:55:59.549834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1696/3342] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:55:59.565785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:59.566395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:59.572938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:59.573381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:59.574183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:59.574615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:59.663695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-debddd67-a11e-4128-a3c0-634963d0153d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101552 Nov 19 19:55:59.664311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1647/3343] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Nov 19 19:55:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:55:59.742931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:55:59.743572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:55:59.749796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:59.750291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:59.751101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:55:59.751535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:55:59.836606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:55:59.845747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5f20be0e-fd1c-4929-9696-c7f729ed5576 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.107685 Nov 19 19:55:59.846367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1697/3344] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:55:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:00.044378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:56:00.044825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:56:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:56:00.864446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:00.865029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:00.871807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:00.872378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:00.873167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:00.873601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:00.944100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:00.945799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:00.954142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:00.954859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:00.955880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:00.956712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:00.959432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:00.969812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-80ce8796-e11a-4b45-be7a-5689ba82561f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.109535 Nov 19 19:56:00.974095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1648/3345] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:00.976383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-4fa4ef56-d24f-407b-bf7b-67b1287c19a5 req-7d7e71b8-2079-4a10-a7ba-16af5422100c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9233030-c878-4eef-a231-13ba34eae0c2", "tag": "098b2daa-b628-41ee-b4c2-112143fa0d32"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:00.977954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:56:00.977954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:56:00.985719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-4fa4ef56-d24f-407b-bf7b-67b1287c19a5 req-7d7e71b8-2079-4a10-a7ba-16af5422100c service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:00.985962 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-4fa4ef56-d24f-407b-bf7b-67b1287c19a5 req-7d7e71b8-2079-4a10-a7ba-16af5422100c service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:01.006309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-4fa4ef56-d24f-407b-bf7b-67b1287c19a5 req-7d7e71b8-2079-4a10-a7ba-16af5422100c service nova] Creating event network-changed:098b2daa-b628-41ee-b4c2-112143fa0d32 for instance e9233030-c878-4eef-a231-13ba34eae0c2 on hv-cinder-77703 Nov 19 19:56:01.011836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-4fa4ef56-d24f-407b-bf7b-67b1287c19a5 req-7d7e71b8-2079-4a10-a7ba-16af5422100c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039902 Nov 19 19:56:01.013024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1649/3346] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:56:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:56:01.036339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af97d928-a419-476d-9913-0e55f4dab8b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.095521 Nov 19 19:56:01.037341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1698/3347] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:00 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 19 19:56:01.987468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:01.990251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:01.997404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:01.997890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:01.998788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:01.999221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:02.048293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:02.049453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:02.056827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:02.057273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:02.058062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:02.058532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:02.065992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:02.074899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f54c6b93-8060-4ae0-a28a-ed58bdd7ca34 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091547 Nov 19 19:56:02.075777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1650/3348] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:02.121347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e83c4e4-61ea-4c8f-94b2-fe04b8c69df3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.077281 Nov 19 19:56:02.121989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1699/3349] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:02 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:03.093549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:03.094166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:03.100963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:03.101409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:03.102216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:03.102648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:03.133433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:03.134574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:03.142368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:03.142902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:03.143755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:03.144253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:03.164897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:03.173132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c378ee13-0301-49f6-9e2c-163b59de6b28 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083652 Nov 19 19:56:03.173682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1651/3350] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:03.205413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b487c4d9-e220-4b89-a64e-0792d3108798 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.076385 Nov 19 19:56:03.208818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1700/3351] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:03 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:04.192442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:04.193080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:04.201139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:04.201669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:04.202569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:04.203071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:04.217573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:04.218768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:04.226127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:04.226739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:04.227987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:04.228564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:04.274592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:04.282936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-088ecd86-67bc-4a8b-a1fd-26c3e6313a02 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095946 Nov 19 19:56:04.283514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1652/3352] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:04.295812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-45fda3d8-fc37-412a-9a04-a115c94dfdc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.082407 Nov 19 19:56:04.296454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1701/3353] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:04 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:05.300921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:05.301815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:05.307569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:05.308578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:05.308765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:05.309095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:05.309896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:05.310374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:05.315729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:05.316179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:05.317001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:05.317423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:05.375485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:05.377356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e603590-268f-44d3-91e4-0078f5afd9f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.073963 Nov 19 19:56:05.378218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1702/3354] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:05 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:05.385044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3ce5e534-0679-4204-bae6-7dee4ff03c21 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087764 Nov 19 19:56:05.385615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1653/3355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:06.393264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:06.394765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:06.402474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:06.403106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:06.403769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:06.404226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:06.405080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:06.405559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:06.409781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:06.410293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:06.411078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:06.411511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:06.467147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c2602a30-3e63-4ce4-970a-045e5090bbdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.080432 Nov 19 19:56:06.470526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1703/3356] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:06 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:06.480884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:06.489809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c352a324-731e-44c4-be81-7baee44e3c45 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091091 Nov 19 19:56:06.490398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1654/3357] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:07.480930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:07.481930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:07.489154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:07.489615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:07.490418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:07.490845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:07.507219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:07.507810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:07.514979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:07.515428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:07.516209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:07.516637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:07.555223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-09525262-e20f-4657-9520-89c32d8b4383 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.078229 Nov 19 19:56:07.555880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1704/3358] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:07 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:07.578274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:07.586847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f67db49-7420-4a44-af0b-e8ce59be1e94 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083762 Nov 19 19:56:07.587467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1655/3359] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:08.567024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:08.568028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:08.575555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:08.576003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:08.576771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:08.577199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:08.604142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:08.604822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:08.613910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:08.614302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:08.615457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:08.616253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:08.638224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fdd1d992-b8d1-44d8-b3a7-1ead307d56de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.075088 Nov 19 19:56:08.638890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1705/3360] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:08 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:08.682632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:08.695155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bb2729a2-6bcc-4b56-8a03-1939069dd717 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094742 Nov 19 19:56:08.695931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1656/3361] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:09.651736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:09.652672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:09.666272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:09.666716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:09.668029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:09.668029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:09.716912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:09.717536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:09.724218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:09.724671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:09.725541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:09.725975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:09.732234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc3f955a-e883-4fc5-945f-434525f27dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.085423 Nov 19 19:56:09.735778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1706/3362] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:09 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:09.789866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:09.798306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1fbbec50-9ad3-4fb6-b771-da43cb0fdec9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086199 Nov 19 19:56:09.798853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1657/3363] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:10.744952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:10.746027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:10.753971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:10.754487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:10.755312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:10.755785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:10.815149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-766e9d4a-f391-4979-a62a-c4f3f3d8b639 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 14 microversion: 2.1 time: 0.074697 Nov 19 19:56:10.818423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1707/3364] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:10 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 14 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 19:56:10.818602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:10.818602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:10.824144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:10.824584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:10.825356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:10.825779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:11.055921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:11.066431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d167e28c-ee27-41ff-8921-02b3a754cf11 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.254085 Nov 19 19:56:11.067129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1658/3365] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:11.827516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:11.828512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:11.836210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:11.836654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:11.837416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:11.837847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:11.919343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b60d3d1d-8dcf-441c-97d4-ac0cf1a9807c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 10009 microversion: 2.1 time: 0.095718 Nov 19 19:56:11.919987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1708/3366] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:11 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 10009 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:12.091728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:12.091728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:12.101108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:12.101427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:12.102223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:12.102687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:12.170339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:12.178652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-684123b7-1440-40f4-848a-40e9b7221f88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093017 Nov 19 19:56:12.179211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1659/3367] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:12.933032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:12.934074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:12.941444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:12.941886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:12.942837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:12.943265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:13.033349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ff294cdd-6b74-4507-9782-f52c6541a81e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 17459 microversion: 2.1 time: 0.105139 Nov 19 19:56:13.034366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1709/3368] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:12 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 17459 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:13.197456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:13.198483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:13.207924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:13.208375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:13.209175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:13.210257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:13.283482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:13.297123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-587db37c-1008-4d6b-92f1-53232b711540 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.104330 Nov 19 19:56:13.297775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1660/3369] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:14.046803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:14.047827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:14.055545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:14.055990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:14.056757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:14.057182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:14.132005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6eb94cb1-4401-41cd-bc68-4903491c4d90 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 18449 microversion: 2.1 time: 0.088939 Nov 19 19:56:14.133425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1710/3370] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:14 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 18449 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:14.317048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:14.317564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:14.325047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:14.325499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:14.326323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:14.326759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:14.397515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:14.409302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-16aeb776-53c8-4e7f-8a32-bebdc4e66752 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097734 Nov 19 19:56:14.409992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1661/3371] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:15.144222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:15.145251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:15.153053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:15.153501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:15.154301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:15.154733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:15.228699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a5a0941-e017-4ed2-bffd-d56cdec2eba7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 21227 microversion: 2.1 time: 0.088425 Nov 19 19:56:15.229377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1711/3372] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:15 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 21227 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:15.427713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:15.428354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:15.436358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:15.436798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:15.437577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:15.438011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:15.504312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:15.516598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e4f0954c-7e33-4528-a894-65ac3d90b868 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092438 Nov 19 19:56:15.517439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1662/3373] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:16.241832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:16.242867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:16.250481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:16.250929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:16.251739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:16.252160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:16.325160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-300d70d4-7276-4a97-9174-0df49618e90d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 23039 microversion: 2.1 time: 0.087343 Nov 19 19:56:16.325793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1712/3374] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:16 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 23039 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:16.535969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:16.536560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:16.543626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:16.544075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:16.544859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:16.545304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:16.608091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:16.620866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0b64a32b-6f8d-4ab2-af5b-65adc6aca889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088426 Nov 19 19:56:16.621558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1663/3375] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:17.341165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:17.342382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:17.351998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:17.352606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:17.353668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:17.354105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:17.424646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32a8f4e7-7638-442b-a0f1-ca12b880b1fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 24325 microversion: 2.1 time: 0.090066 Nov 19 19:56:17.425295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1713/3376] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:17 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 24325 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:17.642855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:17.643490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:17.651207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:17.651653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:17.652422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:17.652851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:17.728226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:17.736902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85a793e4-ccad-4b41-b7a6-3cc0b27d0a27 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097736 Nov 19 19:56:17.737494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1664/3377] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:18.439449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:18.440449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:18.447664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:18.448108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:18.448912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:18.449346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:18.522671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f67a0aca-fc64-4b0e-980b-5375b4c4f057 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 25974 microversion: 2.1 time: 0.089230 Nov 19 19:56:18.523265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1714/3378] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:18 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 25974 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 19:56:18.758437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:18.759201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:18.766003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:18.766477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:18.767248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:18.767704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:18.829185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:18.838027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-14064509-47c2-4fba-9901-8664881ddb59 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085247 Nov 19 19:56:18.838624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1665/3379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:19.536498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:19.537679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:19.546130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:19.546634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:19.547465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:19.548016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:19.627336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a35a8b18-a474-4623-989c-66eaf1c38b91 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 27211 microversion: 2.1 time: 0.095248 Nov 19 19:56:19.628238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1715/3380] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:19 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 27211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:19.856219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:19.857001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:19.866127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:19.866692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:19.868368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:19.868368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:19.930416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:19.938871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0fc9d19c-06ea-4443-acdb-a74e0582831c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086515 Nov 19 19:56:19.939433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1666/3381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:20.641013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:20.641924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:20.651411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:20.651859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:20.652644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:20.653071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:20.869146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8abe051-128c-4c11-aec4-9615f5bf7100 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 27914 microversion: 2.1 time: 0.231984 Nov 19 19:56:20.869819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1716/3382] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:20 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 27914 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:20.956190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:20.956791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:20.963833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:20.964810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:20.965944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:20.966589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:21.051880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:21.064238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-00e1013c-9e83-4eac-a33e-8158240125ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.111515 Nov 19 19:56:21.064865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1667/3383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:21.884413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:21.885429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:21.892694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:21.893142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:21.893906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:21.894370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:21.973257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c77c513c-05af-4ecd-8bf0-2bf8eba0f788 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 28158 microversion: 2.1 time: 0.094068 Nov 19 19:56:21.974077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1717/3384] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:21 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 28158 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:22.081970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:22.082616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:22.089906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:22.090397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:22.091202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:22.091642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:22.154588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:22.167851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-67b110ff-a8c6-4b76-a2a9-5bdcb70f39c1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089328 Nov 19 19:56:22.168647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1668/3385] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:22.990759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:22.992081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:22.999784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:23.000229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:23.001033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:23.001465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:23.065521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-159c90f4-6c75-4b94-9c6f-7e29bda4bbae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 28158 microversion: 2.1 time: 0.080098 Nov 19 19:56:23.066176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1718/3386] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:22 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 28158 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:23.184805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:23.185424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:23.192462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:23.192911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:23.193793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:23.194239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:23.255840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:23.264124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-98397738-8a92-4111-b990-cf9cf32d3caa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083075 Nov 19 19:56:23.264686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1669/3387] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:24.079734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:24.080755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:24.088922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:24.089366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:24.090545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:24.090956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:24.169491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d6b6b44a-8e97-4521-bd21-0e1f72994b12 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 28449 microversion: 2.1 time: 0.094924 Nov 19 19:56:24.170148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1719/3388] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:24 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 28449 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:24.281053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:24.281621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:24.288540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:24.288991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:24.289776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:24.290516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:24.357550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:24.371590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aee4b24e-accd-4083-afce-62ced1caae25 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094265 Nov 19 19:56:24.372135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1670/3389] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:25.184135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:25.185133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:25.192625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:25.193042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:25.193900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:25.194408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:25.273385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79c8a1b4-0a6c-477f-9571-5f2b34da1cfa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 28617 microversion: 2.1 time: 0.094061 Nov 19 19:56:25.274155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1720/3390] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:25 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 28617 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:25.392174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:25.392804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:25.403180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:25.403766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:25.405689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:25.406388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:25.472861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:25.481556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-448c9dad-6605-45aa-8de0-4d592673fdaf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093380 Nov 19 19:56:25.482164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1671/3391] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:26.285475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:26.286557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:26.295758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:26.296257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:26.297480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:26.297911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:26.365602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a40c916-560d-4801-8e69-48b242847ab0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 28617 microversion: 2.1 time: 0.083973 Nov 19 19:56:26.366272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1721/3392] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:26 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 28617 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:26.504899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:26.505736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:26.515787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:26.516296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:26.517402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:26.517896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:26.585910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:26.595202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0aa95572-c8b5-430a-8bbc-5631f1ea7967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095706 Nov 19 19:56:26.595767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1672/3393] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:27.377703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:27.378736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:27.385977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:27.386447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:27.387212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:27.387645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:27.455034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a420b38a-faad-465a-85bc-22a777c3d554 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 28617 microversion: 2.1 time: 0.081191 Nov 19 19:56:27.455709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1722/3394] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:27 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 28617 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:27.612936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:27.613567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:27.620939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:27.621415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:27.622283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:27.622732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:27.688909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:27.697890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e365dac2-a3da-459e-b2f9-11af3fb0310b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088893 Nov 19 19:56:27.698416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1673/3395] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:28.472904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:28.474033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:28.481484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:28.481900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:28.482982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:28.483157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:28.572107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6bac9f4b-011a-41a7-badb-254e21935ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 30177 microversion: 2.1 time: 0.103305 Nov 19 19:56:28.572650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1723/3396] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:28 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 30177 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:28.716277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:28.716911 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:28.723593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:28.724032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:28.724807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:28.725202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:28.786583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:28.795308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-516acb3c-c96e-42ca-9971-2ecd20662492 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083105 Nov 19 19:56:28.795859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1674/3397] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:29.588429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:29.589335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:29.597013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:29.597465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:29.598280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:29.598710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:29.677037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c1975d64-36e6-49cd-9716-b5f58ffba51e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 32142 microversion: 2.1 time: 0.095335 Nov 19 19:56:29.677678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1724/3398] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:29 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 32142 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:29.812188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:29.812813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:29.819859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:29.820309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:29.821059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:29.821632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:29.885165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:29.893587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f4634d88-035b-4a5b-bf3a-2049838ba3f8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085069 Nov 19 19:56:29.894194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1675/3399] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:30.691091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:30.692005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:30.700424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:30.700871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:30.701666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:30.702124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:30.780262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5ececd7d-a5c7-4772-a1da-89ab7e1a9279 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 33200 microversion: 2.1 time: 0.093171 Nov 19 19:56:30.780931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1725/3400] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:30 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 33200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:30.911258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:30.911892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:30.919030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:30.919501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:30.920299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:30.920731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:30.989069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:30.997672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a15af13-9567-48e0-988d-76c299107221 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090211 Nov 19 19:56:30.998304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1676/3401] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:31.793965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:31.794878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:31.802340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:31.802814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:31.803606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:31.804002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:31.885333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79e2edce-12b1-436d-8bd2-c39b39137cbd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 34299 microversion: 2.1 time: 0.094372 Nov 19 19:56:31.885884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1726/3402] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:31 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 34299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:32.017272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:32.017991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:32.024995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:32.025579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:32.026530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:32.026968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:32.092081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:32.102035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-874bf772-f164-49c0-9abd-2f778f1d0ee4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089993 Nov 19 19:56:32.102660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1677/3403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:32.902493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:32.904173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:32.915051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:32.916103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:32.917090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:32.917516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:32.991557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3f66daef-4830-4d2a-bdc0-72de7108d31d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 35683 microversion: 2.1 time: 0.095084 Nov 19 19:56:32.992210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1727/3404] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:32 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 35683 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:33.121613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:33.122475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:33.132139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:33.132695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:33.133809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:33.134480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:33.200582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:33.208950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59e6236f-6fdf-4801-a7cb-9d813bd5107c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093352 Nov 19 19:56:33.209469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1678/3405] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:34.006714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:34.007826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:34.019639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:34.020226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:34.021264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:34.021756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:34.099620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4819f773-2c0a-454c-afd1-b68bae1ff535 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 37224 microversion: 2.1 time: 0.098924 Nov 19 19:56:34.100328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1728/3406] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:33 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 37224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:34.228762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:34.229568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:34.237459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:34.237886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:34.238740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:34.239172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:34.303006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:34.315961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8d04ca9e-ff2a-43c5-9bed-158f33aa807b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090761 Nov 19 19:56:34.316777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1679/3407] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:35.112494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:35.113494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:35.121337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:35.121792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:35.122784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:35.123092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:35.199300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c1e811df-d4ab-4cb1-896a-37c0262bede0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 38150 microversion: 2.1 time: 0.090803 Nov 19 19:56:35.199982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1729/3408] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:35 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 38150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:35.335616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:35.336202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:35.343586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:35.344100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:35.344875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:35.345307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:35.410609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:35.426231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3a38f15-eb6a-4efb-b769-36403e3f6f2e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093940 Nov 19 19:56:35.426961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1680/3409] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:36.212653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:36.214129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:36.221775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:36.222263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:36.223034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:36.223467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:36.288595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-51c0bb9b-ca43-4272-b865-266ad9adfcb6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 38150 microversion: 2.1 time: 0.080033 Nov 19 19:56:36.289284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1730/3410] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:36 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 38150 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:36.443837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:36.444482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:36.451645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:36.452098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:36.452886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:36.453320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:36.516986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:36.525411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de511f10-e80c-45da-9e23-fb34f416d7ac tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085260 Nov 19 19:56:36.525983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1681/3411] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:37.303907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:37.305160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:37.313866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:37.314367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:37.315148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:37.315782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:37.385814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c07455e6-d39c-48ae-86d3-a0f175791fb3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 38150 microversion: 2.1 time: 0.087247 Nov 19 19:56:37.386702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1731/3412] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:37 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 38150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:37.543248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:37.544448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:37.551200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:37.551653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:37.552432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:37.552866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:37.624800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:37.633229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e91fb8ff-e05c-4591-af68-466a8be98889 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093828 Nov 19 19:56:37.633803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1682/3413] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:38.399405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:38.400408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:38.407900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:38.408352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:38.409128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:38.409596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:38.473309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-24da6588-8cf7-4890-b134-7c45d2ec47ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 38150 microversion: 2.1 time: 0.077690 Nov 19 19:56:38.473985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1732/3414] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:38 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 38150 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:38.650439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:38.651019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:38.657954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:38.658615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:38.659395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:38.659827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:38.722107 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:38.734157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-77cd200a-d0d5-4613-a923-6fbd596ab196 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087462 Nov 19 19:56:38.734731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1683/3415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:39.487104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:56:39.488106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:39.495482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:39.495922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:39.496692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:39.497115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:39.577931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e3da7582-22a9-40c5-9977-d8ec583449ae tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 38281 microversion: 2.1 time: 0.094386 Nov 19 19:56:39.578562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1733/3416] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 19:56:39 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 38281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 19:56:39.588831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:39.589709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:39.596113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:39.596557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:39.597320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:39.597748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:39.622794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0703672d-58e0-4dcd-8173-3bd87dd76d36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/ips" status: 200 len: 144 microversion: 2.1 time: 0.037612 Nov 19 19:56:39.623463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1684/3417] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Nov 19 19:56:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:56:39.752963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:39.753775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:39.761603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:39.762158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:39.762996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:39.763480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:39.887015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:39.900757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-635d4ae3-a4d8-48f9-8cdf-4615266f6c7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.152575 Nov 19 19:56:39.901542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1734/3418] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:40.921515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:40.922330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:40.930704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:40.931268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:40.932240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:40.932751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:40.996240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:41.004577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d13ccdd0-99de-4397-8b26-3c346e0d9058 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088075 Nov 19 19:56:41.005143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1685/3419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:42.020772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:42.021409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:42.028173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:42.028625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:42.029473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:42.030645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:42.101782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:42.114641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e917301b-148c-4605-b560-918f33c0e339 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097275 Nov 19 19:56:42.115404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1735/3420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:43.135633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:43.136273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:43.143255 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:43.143713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:43.144506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:43.144921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:43.215777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:43.228204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e691c2af-5401-41cd-9969-3739a081e75e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096094 Nov 19 19:56:43.228932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1686/3421] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:44.248012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:44.248609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:44.256165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:44.256618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:44.257445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:44.257924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:44.324866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:44.337400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-555c10df-3b58-419a-af09-f669c8688baa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094253 Nov 19 19:56:44.338074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1736/3422] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:45.356458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:45.357059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:45.364329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:45.364774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:45.365547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:45.365977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:45.427808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:45.439243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-171d6ad7-dd9f-4492-97ff-feb4de9642ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086478 Nov 19 19:56:45.439863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1687/3423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:46.457808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:46.458473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:46.465603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:46.466072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:46.466858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:46.467291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:46.533723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:46.542611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ed8b02f3-09bf-4885-bc45-2afe876701c7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088559 Nov 19 19:56:46.543152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1737/3424] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:47.559873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:47.560504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:47.567876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:47.568323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:47.569100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:47.569534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:47.634032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:47.643324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a62be60-898c-4fc5-935d-10add8fb5ce9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087219 Nov 19 19:56:47.643896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1688/3425] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:48.660986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:48.662081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:48.668445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:48.668892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:48.669658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:48.670110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:48.741612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:48.753194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e246e763-f766-4fa4-8a9f-49afe1cb0ed4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096559 Nov 19 19:56:48.753767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1738/3426] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:49.770883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:49.771525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:49.778291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:49.778732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:49.779499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:49.779928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:49.845525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:49.854168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7db358d-b071-4b57-a596-b5af98ca7f8d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087288 Nov 19 19:56:49.854747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1689/3427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:50.871658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:50.872314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:50.879403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:50.879844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:50.880609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:50.881035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:50.946224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:50.958593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-922a22f2-cc38-424e-85fb-d6bfe3fd7c00 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090352 Nov 19 19:56:50.959221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1739/3428] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:51.980092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:51.980738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:51.988168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:51.988606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:51.989383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:51.989822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:52.059134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:52.067984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4c165235-b52f-4ac0-8a03-894ecc087164 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091610 Nov 19 19:56:52.068547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1690/3429] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:53.088037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:53.088691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:53.098524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:53.098974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:53.099742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:53.100168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:53.172167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:53.184573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-429cbe1f-a920-4c8d-bd62-04bfcbd95eb4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.101588 Nov 19 19:56:53.185287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1740/3430] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:54.209286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:54.210304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:54.217114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:54.217593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:54.218418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:54.218853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:54.282358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:54.291118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-416c34f0-0689-48df-bcad-1e68e3cf66c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089791 Nov 19 19:56:54.291702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1691/3431] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:55.310865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:55.311911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:55.321133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:55.321900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:55.322388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:55.322810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:55.385230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:55.398865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c0575254-a125-4ba5-b2da-1c79fd2e68fb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093510 Nov 19 19:56:55.399587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1741/3432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:56.421521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:56.422191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:56.429468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:56.429897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:56.430732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:56.431165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:56.503371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:56.515342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e7f28ffa-02a6-4c68-ad8b-56847177b630 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097164 Nov 19 19:56:56.516146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1692/3433] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:57.537397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:57.538072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:57.549560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:57.550003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:57.551603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:57.552028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:57.625459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:57.636037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a3857a6e-0142-4362-b0de-3ece7938966b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.102440 Nov 19 19:56:57.636803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1742/3434] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:58.653480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:58.654089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:58.660944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:58.661391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:58.662207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:58.662638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:58.728369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:58.736789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ef7084b-5eee-4b94-8d29-a85c0abe298a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087218 Nov 19 19:56:58.737324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1693/3435] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:56:59.754081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:56:59.754698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:56:59.761670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:59.762170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:59.762987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:56:59.763392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:56:59.823635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:56:59.832153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fea6ca71-827b-4b91-a77f-22464085a073 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.081833 Nov 19 19:56:59.832717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1743/3436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:56:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:00.857436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:00.858069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:00.867274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:00.867763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:00.868545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:00.868982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:00.939199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:00.948398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-78aa5145-f2f3-42db-821a-a8f41c408a7e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096730 Nov 19 19:57:00.948981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1694/3437] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:01.968075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:01.968874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:01.977206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:01.977649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:01.978451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:01.978879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:02.039784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:02.048236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0a5c633-7d73-4c08-a646-23a0b68bab47 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085569 Nov 19 19:57:02.048820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1744/3438] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:03.068329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:03.069198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:03.078438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:03.079077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:03.080202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:03.080827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:03.155239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:03.163447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e62776a-b9fa-4765-88d2-704e8ab18b84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.100474 Nov 19 19:57:03.164019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1695/3439] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:04.185171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:04.185839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:04.192280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:04.192725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:04.193505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:04.194019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:04.261362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:04.270282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9290a1b9-98d3-4612-ac48-5d5f0078d36a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088851 Nov 19 19:57:04.272411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1745/3440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:05.287428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:05.288402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:05.294823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:05.295270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:05.296017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:05.296472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:05.363480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:05.372533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79f347d8-d9c4-4622-bc92-e613af3e085c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088890 Nov 19 19:57:05.373152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1696/3441] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:06.392493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:06.393124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:06.402582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:06.403161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:06.404303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:06.404825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:06.468278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:06.477683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95457dfd-4bdb-43c4-8220-0b28e53e70ef tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091028 Nov 19 19:57:06.478406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1746/3442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:07.495730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:07.496359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:07.503368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:07.503861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:07.504591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:07.505057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:07.568760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:07.577486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-01bab7ac-2fe8-4bf5-9d49-d93147d423c9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086141 Nov 19 19:57:07.578062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1697/3443] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:08.596168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:08.596755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:08.604015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:08.604445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:08.605225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:08.605658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:08.677406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:08.685921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-73a1c555-d8f5-4f05-a676-0b48d100d886 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093637 Nov 19 19:57:08.686547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1747/3444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:09.703548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:09.704166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:09.710992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:09.711445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:09.712383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:09.712825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:09.793748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:09.805077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f8584a12-dd2d-4293-b044-fb6c379fd8a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.105362 Nov 19 19:57:09.806316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1698/3445] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:10.897410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:10.898005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:10.907109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:10.907603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:10.908759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:10.909359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:10.972179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:10.982026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-399f2f15-3f4a-4994-97a2-0409fa900fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.160923 Nov 19 19:57:10.982616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1748/3446] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:11.998954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:11.999597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:12.006439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:12.006884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:12.007658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:12.008085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:12.073153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:12.081585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b1bb3ba-41d6-4e6e-8da2-57ad00d40eb2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086411 Nov 19 19:57:12.082189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1699/3447] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:13.098959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:13.099588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:13.106569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:13.107012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:13.107783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:13.108215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:13.177065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:13.185039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-64a0dc4e-a345-476c-90b1-f1e38bdd2425 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089690 Nov 19 19:57:13.185631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1749/3448] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:14.202417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:14.203225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:14.210714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:14.211155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:14.211945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:14.212374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:14.278644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:14.288723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1825bb5-1b2d-462c-9504-9b264b60c8e8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089966 Nov 19 19:57:14.289309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1700/3449] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:14.316841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:14.317451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:14.324705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:14.325130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:14.326170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:14.326812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:14.353476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:57:14.440727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-777cc626-3af6-4218-b3d3-2957c9715a10 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 204 len: 0 microversion: 2.1 time: 0.127302 Nov 19 19:57:14.441958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1750/3450] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:57:14 2021] DELETE /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:57:14.450082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:14.450691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:14.456928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:14.457316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:14.458071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:14.458511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:14.599312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:14.608285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-abb780b3-3bf6-47ae-8f72-0217e8a77fc1 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1513 microversion: 2.1 time: 0.162148 Nov 19 19:57:14.609103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1701/3451] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:14 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:15.309399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:15.310578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:15.320477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:15.321264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:15.322951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:15.323748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:15.464986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:15.479292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d7ea5b3-61cf-456a-9a4c-69d309976c79 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.175146 Nov 19 19:57:15.480331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1751/3452] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:57:15.519898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-0b9eb206-3568-4544-a664-2a740bbb1f8a req-1a01633a-1dbb-4eee-a3db-bafb7e5fea9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44827b1f-caee-49a9-a965-3b186454972f", "name": "network-vif-deleted", "tag": "1d493c07-2d7d-41c0-9104-2f6c85143734"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:57:15.521605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:57:15.521605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 19:57:15.532815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-0b9eb206-3568-4544-a664-2a740bbb1f8a req-1a01633a-1dbb-4eee-a3db-bafb7e5fea9d service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:15.533293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-0b9eb206-3568-4544-a664-2a740bbb1f8a req-1a01633a-1dbb-4eee-a3db-bafb7e5fea9d service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:15.546200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-0b9eb206-3568-4544-a664-2a740bbb1f8a req-1a01633a-1dbb-4eee-a3db-bafb7e5fea9d service nova] Creating event network-vif-deleted:1d493c07-2d7d-41c0-9104-2f6c85143734 for instance 44827b1f-caee-49a9-a965-3b186454972f on hv-cinder-77703 Nov 19 19:57:15.552347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-0b9eb206-3568-4544-a664-2a740bbb1f8a req-1a01633a-1dbb-4eee-a3db-bafb7e5fea9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037004 Nov 19 19:57:15.553014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1702/3453] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:57:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 19:57:15.627967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:15.628982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:15.636898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:15.638466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:15.639401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:15.640195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:15.698158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:15.698897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:15.699351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lazy-loading 'fault' on Instance uuid 44827b1f-caee-49a9-a965-3b186454972f {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:57:15.751684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:15.761721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b4958c2d-9e11-4f5e-be87-17eaae1fda26 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 200 len: 1397 microversion: 2.1 time: 0.138228 Nov 19 19:57:15.762748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1752/3454] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:15 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 1397 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:57:16.511344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:16.511946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:16.519010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.519456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.520235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.520803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.586835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:16.596970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b82b0461-f52b-48d1-bc6f-c20d65bbeb46 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090310 Nov 19 19:57:16.597565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1703/3455] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:16.781063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:16.781651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 44827b1f-caee-49a9-a965-3b186454972f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:16.788429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.788877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.790157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.790591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.807226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] HTTP exception thrown: Instance 44827b1f-caee-49a9-a965-3b186454972f could not be found. Nov 19 19:57:16.808047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Returning 404 to user: Instance 44827b1f-caee-49a9-a965-3b186454972f could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:57:16.808985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f70755ff-d513-4dc3-bbc8-65f650f6586d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f" status: 404 len: 111 microversion: 2.1 time: 0.031902 Nov 19 19:57:16.809567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1753/3456] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:16 2021] GET /compute/v2.1/servers/44827b1f-caee-49a9-a965-3b186454972f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:57:16.817600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:16.818110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:16.824715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.825153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.825932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.826396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.855149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 19:57:16.940817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-260e5d17-b492-4bb9-afe7-0fe146a5775e tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 204 len: 0 microversion: 2.1 time: 0.126575 Nov 19 19:57:16.941531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1704/3457] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 19:57:16 2021] DELETE /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 19:57:16.952293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:16.952935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:16.959242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.959683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:16.960459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:16.960890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:17.108702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:17.116265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6e5bef5-3294-4246-a4c1-511c40021660 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1512 microversion: 2.1 time: 0.169405 Nov 19 19:57:17.116830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1754/3458] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:16 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:17.615268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:17.615863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:17.623416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:17.623869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:17.624674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:17.625102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:17.704288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:17.713507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9c8f8b9a-14ad-458d-a3ae-ccb6a512468a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.102323 Nov 19 19:57:17.714675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1705/3459] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:17.941044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-e69223ef-2b10-4f6e-83c2-d0ec6928ed0a req-b04bbcc8-db64-4a39-9461-be80859a595b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f", "name": "network-vif-deleted", "tag": "f82ab65b-821b-424a-8b41-fb4528d15f92"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 19:57:17.942638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 19:57:17.942638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 19:57:17.954160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-e69223ef-2b10-4f6e-83c2-d0ec6928ed0a req-b04bbcc8-db64-4a39-9461-be80859a595b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:17.954598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-e69223ef-2b10-4f6e-83c2-d0ec6928ed0a req-b04bbcc8-db64-4a39-9461-be80859a595b service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:17.972846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-e69223ef-2b10-4f6e-83c2-d0ec6928ed0a req-b04bbcc8-db64-4a39-9461-be80859a595b service nova] Creating event network-vif-deleted:f82ab65b-821b-424a-8b41-fb4528d15f92 for instance 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f on hv-cinder-77703 Nov 19 19:57:17.977887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-e69223ef-2b10-4f6e-83c2-d0ec6928ed0a req-b04bbcc8-db64-4a39-9461-be80859a595b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040771 Nov 19 19:57:17.978520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1755/3460] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 19:57:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 19:57:18.135468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:18.136002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:18.142949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:18.143415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:18.144188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:18.144612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:18.176857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:18.177259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:18.177739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lazy-loading 'fault' on Instance uuid 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 19:57:18.225109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:18.234602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1aaf461f-8226-4e5b-8a54-84efb46a7218 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 200 len: 1307 microversion: 2.1 time: 0.102869 Nov 19 19:57:18.235163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1706/3461] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:18 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:18.732192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:18.732807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:18.739607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:18.740042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:18.740896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:18.741242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:18.812830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:18.822282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-579b6fc9-4448-4c35-8f7d-b1dfbacbe151 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094346 Nov 19 19:57:18.822845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1756/3462] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:19.252010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:19.252626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:19.259253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:19.259696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:19.260490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:19.260913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:19.274914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] HTTP exception thrown: Instance 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f could not be found. Nov 19 19:57:19.275503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Returning 404 to user: Instance 0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 19:57:19.276336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d39864f0-f8a8-40d3-8a55-dc70d2511664 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f" status: 404 len: 111 microversion: 2.1 time: 0.028136 Nov 19 19:57:19.276971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1707/3463] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:19 2021] GET /compute/v2.1/servers/0a4b5b4a-c8ad-43d2-89e2-bb638c5b5d2f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 19:57:19.840799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:19.841597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:19.848904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:19.849415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:19.850255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:19.850684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:19.915145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:19.924580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46d63911-5af3-45ba-9725-013ba3f5b512 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088206 Nov 19 19:57:19.925446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1757/3464] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:20.941816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:20.942635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:20.950091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:20.950561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:20.951397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:20.951837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:21.025755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:21.035259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5139f40d-bf5b-45a4-88af-337edacf9776 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097052 Nov 19 19:57:21.035857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1708/3465] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:22.061056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:22.061688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:22.069016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:22.069468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:22.070322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:22.070757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:22.140050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:22.148576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-13db0107-7365-4709-bff2-2404020b7fce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091972 Nov 19 19:57:22.149164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1758/3466] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:23.166242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:23.166859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:23.174736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:23.175207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:23.175992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:23.176403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:23.240320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:23.248636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07f940df-1992-4edd-aa4f-b498a82e192b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086198 Nov 19 19:57:23.249203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1709/3467] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:24.269628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:24.270609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:24.281772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:24.282575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:24.283973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:24.284729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:24.355355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:24.364706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fc32b7af-1b3f-4991-9399-f17a74e9331f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.100636 Nov 19 19:57:24.365335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1759/3468] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:25.383037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:25.383677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:25.391045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:25.391468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:25.392264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:25.392665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:25.459479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:25.469488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f07e2d94-b635-47a6-b7a4-a6fe2c682ca3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090389 Nov 19 19:57:25.470125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1710/3469] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:26.493801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:26.494607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:26.501705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:26.502194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:26.502986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:26.503414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:26.570900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:26.579461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e61d53fa-e920-40f6-9c40-58631eeca241 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089493 Nov 19 19:57:26.580051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1760/3470] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:27.597103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:27.597708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:27.604324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:27.604765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:27.605550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:27.605998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:27.676622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:27.686350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04ff0231-c0dc-4541-ba3e-fe80bc8f4aed tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092874 Nov 19 19:57:27.686977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1711/3471] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:28.704462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:28.705099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:28.711756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:28.712199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:28.712961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:28.713380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:28.777240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:28.786009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-093bc040-ea2c-41c5-9764-d8d1f8b6f17a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085481 Nov 19 19:57:28.786608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1761/3472] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:29.803770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:29.804368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:29.812360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:29.812812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:29.813612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:29.814077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:29.880326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:29.889705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0804c95e-4a5a-4b64-ac7d-7943791c2487 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089745 Nov 19 19:57:29.890326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1712/3473] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:30.907374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:30.908074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:30.916022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:30.916472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:30.917259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:30.917689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:30.982832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:30.992074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6d4786dc-cc5d-4a14-8250-7ebe67f1350c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088790 Nov 19 19:57:30.992663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1762/3474] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:32.008826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:32.009481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:32.017014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:32.017467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:32.018312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:32.018750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:32.085550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:32.095025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3314b74-35cc-429e-bf73-fc9648db6511 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089849 Nov 19 19:57:32.095624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1713/3475] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:33.113000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:33.113719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:33.120437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:33.120872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:33.121622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:33.124458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:33.195327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:33.204712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a09fa77-1e56-4c06-8133-5e848d763cb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095331 Nov 19 19:57:33.205472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1763/3476] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:34.223659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:34.224288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:34.230752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:34.231195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:34.231968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:34.232403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:34.301033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:34.309261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8d81ed22-d4f7-4b4f-8151-c0accb30e0af tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089374 Nov 19 19:57:34.309860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1714/3477] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:35.329610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:35.330317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:35.337449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:35.337904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:35.338716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:35.339506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:35.408490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:35.416931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8eff98bb-511d-4d8e-8073-9c5651125753 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093124 Nov 19 19:57:35.417573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1764/3478] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:36.434796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:36.435474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:36.442878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:36.443330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:36.444111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:36.444542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:36.513480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:36.522500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b32d3411-8398-426f-9997-68ac0549d4d9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091470 Nov 19 19:57:36.523101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1715/3479] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:37.540035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:37.540605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:37.547637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:37.547970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:37.548853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:37.549309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:37.620543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:37.630582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4e5aebba-a29e-489f-b694-3c95ad18a557 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094052 Nov 19 19:57:37.631403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1765/3480] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:38.648728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:38.649299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:38.656114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:38.656560 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:38.657335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:38.657762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:38.719623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:38.729068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-825056fa-072c-414b-957e-c8dbb569edb8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084492 Nov 19 19:57:38.729652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1716/3481] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:39.745340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:39.746099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:39.753418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:39.753770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:39.754602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:39.755009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:39.819080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:39.827388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6df5d1d7-2097-4f5d-a1fc-b71328bb1d31 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085724 Nov 19 19:57:39.827958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1766/3482] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:40.845455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:40.846266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:40.852811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:40.853256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:40.854031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:40.854497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:40.919468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:40.928849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9574dc76-a87d-45a5-adbd-57cc7fc0bdf8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087061 Nov 19 19:57:40.929437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1717/3483] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:41.946944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:41.947640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:41.954203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:41.954656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:41.955883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:41.956488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:42.021890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:42.030347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2a74aa09-3617-4858-bf43-35bacb26f29f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087085 Nov 19 19:57:42.030903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1767/3484] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:43.048363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:43.049447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:43.056735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:43.057188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:43.057983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:43.058524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:43.181965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:43.192554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-06715228-f462-4274-ad02-0695c9f3150b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.147830 Nov 19 19:57:43.193142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1718/3485] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:44.208947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:44.209867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:44.216624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:44.217065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:44.217875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:44.218331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:44.281359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:44.290414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61df718c-8864-4bbd-9c5a-5bbae4708559 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085157 Nov 19 19:57:44.291000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1768/3486] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:45.310355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:45.311012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:45.318598 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:45.319052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:45.319843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:45.320287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:45.383333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:45.393118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fcf1c8bb-c910-448d-bf42-e290eafffe57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088750 Nov 19 19:57:45.393860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1719/3487] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:46.413349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:46.413997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:46.420783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:46.421226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:46.422007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:46.422464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:46.489915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:46.499305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0fe5bbe9-618b-4f8b-bb78-5484651dbdfe tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089909 Nov 19 19:57:46.500068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1769/3488] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:47.522489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:47.523293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:47.530954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:47.531425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:47.532203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:47.532630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:47.604875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:47.614201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bac329df-a31e-48ac-84ad-28ae404e506b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096630 Nov 19 19:57:47.614783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1720/3489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:48.632440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:48.633071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:48.639685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:48.640130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:48.640900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:48.641328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:48.705151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:48.714375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6da593c-2038-43ad-937d-68934ef2ab6d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085484 Nov 19 19:57:48.714955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1770/3490] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:49.733459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:49.734485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:49.741985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:49.742419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:49.743218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:49.743646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:49.810108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:49.818177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5b99782-f510-4c45-aed6-da5bd6b7b9ae tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089657 Nov 19 19:57:49.818743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1721/3491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:50.835590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:50.836225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:50.843912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:50.844395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:50.845240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:50.845712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:50.908771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:50.917233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eed95be9-d274-4bc2-b190-f0924e434844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085646 Nov 19 19:57:50.917817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1771/3492] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:51.934652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:51.935325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:51.942174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:51.942632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:51.943585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:51.944022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:52.012640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:52.021007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc2e20e2-6aa1-4d2c-9e28-5586bdb8e337 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090046 Nov 19 19:57:52.021582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1722/3493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:53.039731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:53.040370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:53.047153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:53.047607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:53.048357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:53.048810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:53.110936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:53.123333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e82a4dd7-8c62-4ace-9da8-50e7e585e83d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087342 Nov 19 19:57:53.124085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1772/3494] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:54.144518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:54.145571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:54.152655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:54.153102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:54.153897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:54.154381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:54.220643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:54.229742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0351a582-b5b2-4138-83a9-0eab236131b6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090246 Nov 19 19:57:54.230368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1723/3495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:55.250599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:55.251542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:55.258897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:55.259342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:55.260114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:55.260555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:55.324248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:55.332496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b31ad04-947b-4a02-8e3c-409907895267 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087780 Nov 19 19:57:55.333069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1773/3496] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:56.350173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:56.350813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:56.357772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:56.358262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:56.359054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:56.359493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:56.422447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:56.430865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6c550fc-fd33-4afa-b549-588aeb4794bb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084761 Nov 19 19:57:56.431463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1724/3497] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:57.449867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:57.450532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:57.460404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:57.460959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:57.462033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:57.462662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:57.540257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:57.551105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5ade778c-021b-48be-af12-8bbf3733a059 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.105975 Nov 19 19:57:57.551866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1774/3498] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:58.576078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:58.576666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:58.584663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:58.585110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:58.585878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:58.586344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:58.651123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:58.659677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fbdea89a-ead8-430e-841f-f5025beb785b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090021 Nov 19 19:57:58.660245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1725/3499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:57:59.681305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:57:59.681898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:57:59.688625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:59.689078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:59.689852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:57:59.690312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:57:59.761398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:57:59.769737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b2d403fe-06bf-4b6c-a528-fd835731dcd0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092160 Nov 19 19:57:59.770375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1775/3500] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:57:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:00.789917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:00.790656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:00.798489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:00.799022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:00.799909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:00.800456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:00.880829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:00.893057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8b9822c5-20ac-4f59-a169-e027f82bea2f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.108594 Nov 19 19:58:00.893749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1726/3501] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:01.912244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:01.912903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:01.919826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:01.920273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:01.921045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:01.921477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:01.989962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:02.001770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1a2e8b0-d967-4619-9a94-5d8cff9112c8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093977 Nov 19 19:58:02.002606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1776/3502] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:03.020953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:03.021593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:03.028043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:03.028486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:03.029258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:03.029713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:03.092699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:03.104526 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-320387f0-b0f7-4ea0-a852-356b00b4b2cb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088850 Nov 19 19:58:03.105353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1727/3503] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:04.126886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:04.127725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:04.135452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:04.135903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:04.136674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:04.137108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:04.206812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:04.215858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83a997b5-f7aa-463c-afb5-284ba52d0695 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094599 Nov 19 19:58:04.216433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1777/3504] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:05.232682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:05.233331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:05.240378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:05.240833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:05.241638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:05.242076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:05.305112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:05.314352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-239a9ba7-be9b-49ba-9556-89501c0dd600 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084975 Nov 19 19:58:05.315143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1728/3505] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:06.332741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:06.333298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:06.340879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:06.341478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:06.342136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:06.342537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:06.406367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:06.415126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c16cd9d4-b6e3-453e-bf43-7d429d928fe8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086084 Nov 19 19:58:06.415685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1778/3506] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:07.438256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:07.438878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:07.447677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:07.448331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:07.449282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:07.449763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:07.516978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:07.527210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-940b1c50-3980-4f8f-b667-daac95603feb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093514 Nov 19 19:58:07.527784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1729/3507] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:08.545699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:08.546302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:08.552909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:08.553383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:08.554189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:08.554625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:08.625169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:08.634862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83e7e331-c356-44dc-9b15-cb500c9e34eb tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094094 Nov 19 19:58:08.635446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1779/3508] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:09.653799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:09.654424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:09.661057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:09.661510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:09.662334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:09.662771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:09.724837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:09.735712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd87b41a-c4db-4429-b62c-73b4bbfbded8 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085691 Nov 19 19:58:09.736488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1730/3509] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:10.756537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:10.757243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:10.764252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:10.764698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:10.765515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:10.765951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:10.828625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:10.837204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c850bff0-54da-4b8b-8fcb-7e82830e22c3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084349 Nov 19 19:58:10.837779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1780/3510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:11.855513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:11.856192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:11.862986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:11.863453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:11.864221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:11.864658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:11.925769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:11.934697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-94b69418-ee5b-4f6c-ab7e-8d0b65f45634 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083084 Nov 19 19:58:11.935275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1731/3511] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:12.950856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:12.951503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:12.958276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:12.958702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:12.959472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:12.959906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:13.025554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:13.034430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-70e8297b-d22c-4f83-b32f-087400bbeb84 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087250 Nov 19 19:58:13.035011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1781/3512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:14.051729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:14.052359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:14.059305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:14.059755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:14.060566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:14.060996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:14.131398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:14.143413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-abd7e239-00d9-4caa-9d72-377722a1c40c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095129 Nov 19 19:58:14.144116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1732/3513] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:15.162193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:15.162815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:15.170004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:15.170500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:15.171296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:15.171695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:15.234272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:15.242674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9e3aeb0c-4332-410f-a405-cfd417c96979 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084205 Nov 19 19:58:15.243319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1782/3514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:15 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:16.261143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:16.261916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:16.270337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:16.270783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:16.271565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:16.271987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:16.352845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:16.364715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-92155685-f6b9-400e-b38a-078231fb3e19 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.107814 Nov 19 19:58:16.365407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1733/3515] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:17.386891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:17.387755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:17.397737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:17.398234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:17.399237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:17.399816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:17.471676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:17.480063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7c8d2775-4d3b-4e94-8731-5d5489802a5d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.099218 Nov 19 19:58:17.480643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1783/3516] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:18.499324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:18.499941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:18.506890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:18.507269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:18.508065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:18.508470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:18.576839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:18.589005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-656a7e87-3808-4cbd-af83-640b91d963de tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093059 Nov 19 19:58:18.589588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1734/3517] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:19.606741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:19.607395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:19.614136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:19.614595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:19.615363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:19.615794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:19.679368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:19.688499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-badbf4b4-1c46-45fd-9da3-8aa8cf87b8a0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085475 Nov 19 19:58:19.689441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1784/3518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:20.707082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:20.707670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:20.715119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:20.715572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:20.716338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:20.716762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:20.782326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:20.791547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7297277c-0450-41e9-b16d-e56ec14afb48 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087746 Nov 19 19:58:20.792159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1735/3519] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:21.810035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:21.810711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:21.817491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:21.817923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:21.818738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:21.819174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:21.881867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:21.890336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b0809482-6fb1-4f0f-8879-aa305b9b3038 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084335 Nov 19 19:58:21.890911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1785/3520] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:22.908002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:22.908688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:22.915549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:22.916164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:22.916969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:22.917410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:22.990476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:23.002338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6e28e5d-10d3-4181-a630-30e717720773 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097831 Nov 19 19:58:23.003210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1736/3521] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:24.021833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:24.022547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:24.029521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:24.030008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:24.030782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:24.031209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:24.100692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:24.109095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ec92d179-0861-4b6f-85b0-2c944506f119 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090956 Nov 19 19:58:24.109705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1786/3522] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:25.128877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:25.129525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:25.137949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:25.138434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:25.139216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:25.139655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:25.211325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:25.220211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e94a8700-b4c1-4496-98c2-efbacf147dd9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097091 Nov 19 19:58:25.220788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1737/3523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:25 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:26.238799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:26.239442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:26.248241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:26.248666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:26.249442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:26.249865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:26.317462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:26.330513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3e294128-a20c-4df9-8ef2-98ccdb2fb03a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096521 Nov 19 19:58:26.331379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1787/3524] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:27.350507 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:27.351145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:27.358734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:27.359190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:27.359981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:27.360419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:27.426413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:27.438504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4f287745-889e-49c6-a021-e35a4dd40fdd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091685 Nov 19 19:58:27.439096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1738/3525] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:28.458374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:28.458975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:28.465938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:28.466427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:28.467190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:28.467617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:28.528797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:28.539844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d89e158d-0503-458b-9606-65a46784207b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085160 Nov 19 19:58:28.540414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1788/3526] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:29.561666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:29.562537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:29.573848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:29.574322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:29.575092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:29.575518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:29.651750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:29.664156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bacc45f0-18f3-46f2-b963-de21290874e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.110212 Nov 19 19:58:29.664976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1739/3527] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:30.682570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:30.683179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:30.690103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:30.690578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:30.691347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:30.691779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:30.753772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:30.762928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e32be24-9a10-430b-a593-92551bc0a101 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084299 Nov 19 19:58:30.763534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1789/3528] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:31.782386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:31.783119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:31.792451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:31.792903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:31.793694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:31.794169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:31.865385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:31.875765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-13f6ae8b-3d6b-4e35-8ba7-bb8a54c95c01 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.098171 Nov 19 19:58:31.876542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1740/3529] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:32.896301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:32.897014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:32.905444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:32.905891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:32.906695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:32.907128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:32.979042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:32.989070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-07982c17-3152-4b48-bf3e-bbdc389d0ace tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.098519 Nov 19 19:58:32.989659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1790/3530] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:34.011178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:34.012105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:34.018869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:34.019322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:34.020118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:34.020601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:34.087393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:34.097125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79d23b48-4de0-47b5-8fbe-dbeda926c24b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089833 Nov 19 19:58:34.097717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1741/3531] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:35.115505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:35.116137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:35.123093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:35.123536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:35.124300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:35.124725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:35.189040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:35.200528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3b7184a-e694-420a-b53e-769b6a0b8524 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088697 Nov 19 19:58:35.201081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1791/3532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:35 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:36.221946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:36.222616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:36.229414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:36.229870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:36.230684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:36.231120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:36.293715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:36.301888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07697489-c731-4ffd-bea9-02a7796b0f0b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083869 Nov 19 19:58:36.302495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1742/3533] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:37.318942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:37.319641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:37.326472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:37.327539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:37.328331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:37.328757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:37.396537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:37.407588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7d6ddd4-0077-422a-a0f4-d93b39f75c0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092615 Nov 19 19:58:37.408179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1792/3534] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:38.426182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:38.426815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:38.433623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:38.434168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:38.434968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:38.435431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:38.514797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:38.523494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b17b415-b86d-4ce3-95af-899f762cb007 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.101107 Nov 19 19:58:38.524079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1743/3535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:39.541083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:39.541669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:39.548932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:39.549377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:39.550184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:39.550616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:39.622292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:39.631094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-68be719f-8a5f-41e0-a3dc-b76de6e35d4c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093766 Nov 19 19:58:39.631676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1793/3536] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:40.649522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:40.650153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:40.658068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:40.658631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:40.659452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:40.659961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:40.725297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:40.733537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a18e6d0c-d4fa-4095-b3cf-841e5ef16152 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088039 Nov 19 19:58:40.734295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1744/3537] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:41.750636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:41.751371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:41.758569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:41.759027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:41.759832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:41.760264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:41.828128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:41.838035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e3d549d-7dd0-4435-942b-d060fcb2d994 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091032 Nov 19 19:58:41.839003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1794/3538] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:42.855565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:42.856230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:42.863283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:42.863728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:42.864510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:42.864936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:42.929485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:42.938095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b81fe41-611a-4389-a054-f2fe80d2f751 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086234 Nov 19 19:58:42.938681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1745/3539] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:43.956392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:43.956975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:43.964615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:43.965087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:43.965883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:43.966382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:44.030827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:44.039597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eef8b957-4f6a-4b3b-b745-52968ae7f642 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087401 Nov 19 19:58:44.040370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1795/3540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:45.057144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:45.057805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:45.065524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:45.065981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:45.066835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:45.067277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:45.136397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:45.145451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1230cf38-1552-475f-85c5-510094fa0fc3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092196 Nov 19 19:58:45.146040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1746/3541] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:45 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:46.162673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:46.163327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:46.170104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:46.170538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:46.171299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:46.171725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:46.242598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:46.251040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7b75ed76-59c0-41b4-b31f-3e98fd7b27ff tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091992 Nov 19 19:58:46.251795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1796/3542] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:47.270772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:47.271515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:47.278419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:47.278866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:47.279662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:47.280127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:47.360491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:47.370644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-44cefbbb-a55e-4f53-8b87-bdd574c77102 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.104403 Nov 19 19:58:47.371238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1747/3543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:48.388543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:48.389374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:48.397802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:48.398291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:48.399424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:48.399945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:48.465511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:48.474334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6485377e-5ba0-4865-b8eb-b46d492e3bea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089511 Nov 19 19:58:48.474989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1797/3544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:49.492258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:49.492923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:49.499747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:49.500200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:49.501027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:49.501680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:49.564235 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:49.572627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9d24e263-3667-4598-8d1c-6e565be0f4e9 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084098 Nov 19 19:58:49.573223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1748/3545] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:50.590115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:50.590695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:50.597664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:50.598148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:50.598935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:50.599382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:50.664638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:50.673142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-272f6935-09aa-45a1-8c32-ba8e03e523be tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087102 Nov 19 19:58:50.673757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1798/3546] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:51.690399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:51.690991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:51.698066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:51.698531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:51.699332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:51.699773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:51.763715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:51.773092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa6cda2a-ac24-47a4-8bb6-8987386315d4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086624 Nov 19 19:58:51.773727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1749/3547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:58:52.790526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:52.791195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:52.799302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:52.799752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:52.800538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:52.801094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:52.867041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:52.875247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-191eb52a-cbfd-4027-bf6d-db7f22ad279e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088622 Nov 19 19:58:52.875822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1799/3548] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:53.131630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:58:53.132248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:58:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:58:53.896973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:53.897564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:53.904940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:53.905380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:53.906229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:53.906672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:53.981854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:53.990781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a574417d-6c53-4895-85fb-1f5fd9697703 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.100986 Nov 19 19:58:53.991340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1750/3549] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:55.008479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:55.009121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:55.015955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:55.016459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:55.017874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:55.018343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:55.086833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:55.096344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5bfafd04-8ab3-4338-b05c-b68b90b01665 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091640 Nov 19 19:58:55.096936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1800/3550] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:56.113297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:56.113959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:56.120925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:56.121351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:56.122172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:56.122608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:56.187812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:56.201135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f0d3aa5-d7f5-4ae4-81a9-b8e0fabeb223 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091152 Nov 19 19:58:56.202424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1751/3551] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:56 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:56.664657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:58:56.664977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 19:58:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:58:57.225940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:57.226620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:57.234191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:57.234633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:57.235420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:57.235850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:57.305181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:57.314357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79023fc8-9424-48e5-a6f3-a381cc6cf544 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092114 Nov 19 19:58:57.314953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1801/3552] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:58.332040 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:58.332762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:58.339982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:58.340402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:58.341218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:58.341624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:58.417646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:58.426646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3bdb5b2d-5059-4bc1-96ca-ec75cfe0a844 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.098627 Nov 19 19:58:58.427217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1752/3553] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:58:59.448306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:58:59.449394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:58:59.460118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:59.460625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:59.461453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:58:59.462174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:58:59.529855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:58:59.539041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0a8f3c7b-8569-4270-ab7d-e14e3342f212 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097598 Nov 19 19:58:59.539646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1802/3554] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:58:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:00.556464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:00.557076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:00.564384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:00.564908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:00.565751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:00.566295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:00.638569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:00.647676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7ef499d-cfa6-4aa9-a3b5-64db71de60ce tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094990 Nov 19 19:59:00.648258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1753/3555] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:01.667020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:01.667965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:01.677994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:01.678753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:01.679976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:01.680760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:01.748073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:01.756605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be34c6c3-9d79-4f2d-a3a4-10b6ce49c702 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094983 Nov 19 19:59:01.757173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1803/3556] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:02.775775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:02.776686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:02.785574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:02.786325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:02.787364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:02.787960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:02.862140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:02.870217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa1de24c-5eae-41d4-97e8-83feb7f73d4d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.099481 Nov 19 19:59:02.870779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1754/3557] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:03.895286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:03.895936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:03.905196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:03.905706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:03.906860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:03.907440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:03.978970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:03.987210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ee9538e-bd90-45e8-9ce8-e385b129c089 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097850 Nov 19 19:59:03.987770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1804/3558] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:05.004296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:05.004956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:05.011924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:05.012393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:05.013164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:05.013594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:05.092406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:05.100134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a092536-836e-4621-b1f4-062f576ce113 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.099713 Nov 19 19:59:05.100702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1755/3559] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:06.119438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:06.120492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:06.129231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:06.129674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:06.130493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:06.130925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:06.200134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:06.209621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2eb2642e-32b2-43ef-9c23-fcc878546435 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095666 Nov 19 19:59:06.210188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1805/3560] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:06 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:07.229817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:07.230486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:07.237534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:07.237990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:07.238805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:07.239320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:07.315297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:07.326393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f8763514-3b69-4ea3-bfd2-6634aef46afa tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.100270 Nov 19 19:59:07.326971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1756/3561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:08.344302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:08.345069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:08.352396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:08.352844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:08.353623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:08.354083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:08.417864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:08.426295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6c8458a-3326-4581-9dad-dd17344b5e0e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085649 Nov 19 19:59:08.426847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1806/3562] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:09.443790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:09.444429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:09.451376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:09.451920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:09.452695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:09.453291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:09.516373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:09.525250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c4f9d572-799f-47d3-a271-ff13c7353027 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085574 Nov 19 19:59:09.525832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1757/3563] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:09.534996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:59:09.535715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:59:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:59:10.543437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:10.544163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:10.551198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:10.551782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:10.552574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:10.553002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:10.618213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:10.626756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6f89661-4435-4f43-ae54-771963c59967 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087024 Nov 19 19:59:10.627379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1807/3564] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:10 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:11.644632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:11.645221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:11.651958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:11.652409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:11.653187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:11.653617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:11.727047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:11.738483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-80122bfd-49af-45e4-92c1-3a57a541b3a6 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097973 Nov 19 19:59:11.739110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1758/3565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:11 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:12.760331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:12.760951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:12.767705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:12.768150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:12.769539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:12.770079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:12.835784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:12.844763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-91d49333-eebf-4fa5-92f4-d6514dedeb13 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088088 Nov 19 19:59:12.845307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1808/3566] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:12 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:13.868201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:13.868791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:13.875418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:13.875860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:13.876713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:13.877143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:13.957622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:13.966489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-afb52dc1-645e-4dad-893a-5944854a9235 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.102139 Nov 19 19:59:13.967081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1759/3567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:13 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:14.984568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:14.985167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:14.993166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:14.993620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:14.994432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:14.994869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:15.057334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:15.068611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f00e9b11-50ab-4dd2-a07b-53df66d7d3ab tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089400 Nov 19 19:59:15.069174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1809/3568] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:14 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:16.086568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:16.087214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:16.096016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:16.096383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:16.097181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:16.097726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:16.167161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:16.179688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76fc5984-f5a2-45ed-809e-a9d15ecbe0e1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097827 Nov 19 19:59:16.180268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1760/3569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:16 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:17.200363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:17.201025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:17.208211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:17.208639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:17.209452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:17.209854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:17.274637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:17.286573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a1d36e78-f68b-4939-be05-99751297c3e2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090358 Nov 19 19:59:17.287180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1810/3570] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:17 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:18.304145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:18.304757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:18.311857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:18.312338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:18.313129 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:18.313566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:18.376347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:18.385174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ec1c11c-10e2-47b2-8437-ea319fcc7163 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084790 Nov 19 19:59:18.385743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1761/3571] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:18 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:19.403692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:19.404352 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:19.411596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:19.412043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:19.412818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:19.413247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:19.487168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:19.495467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ddb5f78-e376-4f6c-9d7d-74e1b062ff38 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.095530 Nov 19 19:59:19.496027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1811/3572] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:19 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:20.064735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 19:59:20.065049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 19:59:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 19:59:20.517435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:20.518153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:20.525214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:20.525669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:20.526491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:20.526923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:20.595045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:20.603917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-717aa76a-f751-4b2a-937b-1d177a4dabe1 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090347 Nov 19 19:59:20.604496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1762/3573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:20 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:21.621989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:21.622632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:21.629197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:21.629648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:21.630428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:21.631045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:21.703796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:21.715497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4cd2680a-1785-4b61-a445-baaf1bd40f57 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097021 Nov 19 19:59:21.716228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1812/3574] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:21 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:22.735456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:22.736084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:22.742937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:22.743408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:22.744182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:22.744602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:22.816708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:22.825660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-68965a26-16fa-4ae3-a485-8db095f236a3 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094062 Nov 19 19:59:22.826264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1763/3575] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:22 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:23.845125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:23.845762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:23.855744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:23.856377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:23.857532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:23.858091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:23.922526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:23.931218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cd756582-3a21-424f-83cf-d7813c5b0577 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091519 Nov 19 19:59:23.931786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1813/3576] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:23 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:24.948414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:24.949053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:24.955999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:24.956445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:24.957209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:24.957636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:25.025409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:25.033891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1be27628-8d16-4b64-ac64-5b738a8b8f69 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.089151 Nov 19 19:59:25.034500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1764/3577] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:24 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:26.051922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:26.052575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:26.059577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:26.060020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:26.060785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:26.061211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:26.133168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:26.144669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-019be565-165c-43f3-96ba-0da537fcc2b2 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096364 Nov 19 19:59:26.145244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1814/3578] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:26 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:27.162705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:27.163382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:27.170348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:27.170803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:27.171575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:27.171987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:27.247215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:27.255650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3a5b66a4-2f22-41bd-b397-564c9b9ceece tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096635 Nov 19 19:59:27.256248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1765/3579] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:27 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:28.277356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:28.277960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:28.287369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:28.287908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:28.288951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:28.289504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:28.358830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:28.367573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-73a1a9ca-fd18-4727-a666-c3dc1dec5ca0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.096213 Nov 19 19:59:28.368143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1815/3580] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:28 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:29.387996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:29.388633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:29.398298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:29.398857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:29.399926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:29.400536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:29.468241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:29.479440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7b79556b-20a5-44a6-afed-c6a05a6f5797 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097265 Nov 19 19:59:29.479990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1766/3581] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:29 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:30.499297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:30.500205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:30.510036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:30.510692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:30.511473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:30.511920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:30.579015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:30.587406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b2053b0e-da2b-43f6-92dd-f56bb523f50d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094235 Nov 19 19:59:30.588515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1816/3582] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:30 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:59:31.604951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:31.605522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:31.614621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:31.615179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:31.616260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:31.616864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:31.696002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:31.705020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-afbaba00-a003-4575-bd37-de26e9807f56 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.103921 Nov 19 19:59:31.705606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1767/3583] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:31 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:32.730013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:32.730640 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:32.737537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:32.737985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:32.738822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:32.739255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:32.799378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:32.808269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a0fab21-1b7c-45c1-8997-5771e4375e51 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.083956 Nov 19 19:59:32.808845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1817/3584] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:32 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:33.827314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:33.828217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:33.836377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:33.836968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:33.838457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:33.838964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:33.907160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:33.919890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ff55b72-b830-4c71-99d0-72a466e2dcc7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.097590 Nov 19 19:59:33.920606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1768/3585] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:33 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:34.942714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:34.943662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:34.951949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:34.952393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:34.953165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:34.953591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:35.025462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:35.037946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2a6cb913-2f85-40cf-bebe-5b877e03be68 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.100868 Nov 19 19:59:35.038785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1818/3586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:34 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:36.056754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:36.057461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:36.066079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:36.066541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:36.067326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:36.067758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:36.135665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:36.144394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e7743e28-4285-4116-aecf-7035f62f20dd tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091696 Nov 19 19:59:36.144976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1769/3587] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:36 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:37.168818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:37.169503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:37.178403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:37.178801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:37.179579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:37.180017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:37.247215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:37.255542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e0cdb079-c1ec-4cd7-be17-a6d4c333ca5f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092344 Nov 19 19:59:37.256132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1819/3588] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:37 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:38.272784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:38.273386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:38.280416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:38.280874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:38.281644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:38.282078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:38.351664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:38.360401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0ddabc51-abf8-4179-9639-39fdb3bed818 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091316 Nov 19 19:59:38.360990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1770/3589] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:38 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:39.381189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:39.381801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:39.388379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:39.389420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:39.390237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:39.390674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:39.457221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:39.465686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67bf7c2f-1bc8-47db-9d7b-d0ba3c952f37 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088183 Nov 19 19:59:39.466281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1820/3590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:39 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:40.482922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:40.483569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:40.490335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:40.490791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:40.491585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:40.492088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:40.562486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:40.571971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0fc4d09b-6449-47a9-860b-f19130d84b12 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092254 Nov 19 19:59:40.572214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1771/3591] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:40 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:41.590714 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:41.591347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:41.599313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:41.599759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:41.600577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:41.601005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:41.671494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:41.680413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af175af6-d721-4972-b5bd-f314ab23bd23 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093920 Nov 19 19:59:41.681260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1821/3592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:41 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:42.700168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:42.701351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:42.707979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:42.708438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:42.709246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:42.709688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:42.773533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:42.782030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60cd3d08-e670-47b9-9755-ac333a79224a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.085677 Nov 19 19:59:42.782629 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1772/3593] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:42 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:43.800462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:43.801077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:43.807779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:43.808345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:43.809211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:43.809628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:43.875875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:43.884660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b98f82ab-78e1-4374-b0dd-7f9c1c8e10bf tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088593 Nov 19 19:59:43.885233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1822/3594] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:43 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:44.906180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:44.907057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:44.914644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:44.915095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:44.916103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:44.916691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:44.985015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:44.994198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f22e4f57-04c9-4c8e-9e5b-e6bec277dd16 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092598 Nov 19 19:59:44.994784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1773/3595] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:44 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:46.011792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:46.012474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:46.019408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:46.019899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:46.020687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:46.021111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:46.084805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:46.094671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e74264dc-1b82-447b-a446-5bedecb3802e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086422 Nov 19 19:59:46.095358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1823/3596] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:46 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:47.112106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:47.112762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:47.119782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:47.120232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:47.121017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:47.121446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:47.194622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:47.202990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9ab0dab-21b4-4be1-bc54-0bb072f3a63c tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.094679 Nov 19 19:59:47.203789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1774/3597] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:47 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:48.220952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:48.221850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:48.229174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:48.229621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:48.230454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:48.230876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:48.303369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:48.317981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e33495d8-ed77-4a65-9593-d25ec9f1b137 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.100683 Nov 19 19:59:48.319078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1824/3598] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:48 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:49.344646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:49.345941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:49.352546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:49.353001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:49.353809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:49.354294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:49.424383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:49.432742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c965b866-50ea-4a3d-8c26-7c1d751ad607 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.092113 Nov 19 19:59:49.433327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1775/3599] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:49 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 19:59:50.450359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:50.451004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:50.458182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:50.458629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:50.459407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:50.459839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:50.525928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:50.534558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ae50f3e-9708-46ec-abbb-a96c0a83766f tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087972 Nov 19 19:59:50.535152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1825/3600] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:50 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:51.551590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:51.552270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:51.559122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:51.559574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:51.560363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:51.560793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:51.626596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:51.635675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7e5b6d6-a385-4cdd-a733-85a62d1b8710 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.088405 Nov 19 19:59:51.636253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1776/3601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:51 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:52.652971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:52.653575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:52.660549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:52.660988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:52.661758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:52.662219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:52.726241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:52.736739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e3a2f82-dc0c-4f09-b7cb-521c7f2cba88 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.087538 Nov 19 19:59:52.737317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1826/3602] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:52 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:53.755066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:53.755782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:53.768912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:53.769365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:53.770234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:53.770675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:53.843240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:53.852453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f14a9320-b01e-46d1-8c2c-9a9d3dd385b7 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.101897 Nov 19 19:59:53.853066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1777/3603] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:53 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:54.874058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:54.875125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:54.882818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:54.883264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:54.884049 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:54.884509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:54.951448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:54.961005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-698f7345-04dd-4e32-9f1e-f92d1c741f7d tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.093767 Nov 19 19:59:54.961606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1827/3604] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:54 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:55.979326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:55.979988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:55.986948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:55.987407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:55.988315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:55.988670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:56.053530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:56.062217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2af9bd04-9106-4111-84f0-d7d3d81caf0a tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086495 Nov 19 19:59:56.062804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1778/3605] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:55 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:57.081162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:57.081809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:57.088715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:57.089165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:57.089940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:57.090398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:57.152445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:57.160670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3febf87c-9dbf-498a-9938-d37ce93f6974 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084195 Nov 19 19:59:57.161240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1828/3606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:57 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:58.178277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:58.178927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:58.185759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:58.186250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:58.187035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:58.187471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:58.256485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:58.264956 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b50c5a9-b6e7-4b15-b7b2-e6589515c0f4 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090461 Nov 19 19:59:58.265531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1779/3607] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:58 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 19:59:59.283148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 19:59:59.283777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 19:59:59.289968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:59.290447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:59.291228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 19:59:59.291655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 19:59:59.353774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 19:59:59.363751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3f63166-1c4d-4a17-ab1c-bb58f4e2c019 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.084677 Nov 19 19:59:59.364330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1829/3608] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 19:59:59 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:00.380907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:00.381584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:00.388293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:00.388767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:00.389572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:00.390004 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:00.455534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:00.464070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9fa57f8b-35ac-4064-bf7e-3cedcdb3eba0 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.086867 Nov 19 20:00:00.464648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1780/3609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:00 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:01.483277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:01.483912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:01.491026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:01.491533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:01.492289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:01.492718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:01.559459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:01.568121 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c9d7d02a-5570-40ad-9998-d61b2495c729 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090025 Nov 19 20:00:01.568813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1830/3610] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:01 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:02.585496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:02.586111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:02.592833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:02.593291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:02.594076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:02.594540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:02.671397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:02.680626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5dbdf563-52e0-4e74-9698-36a909c07568 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.098960 Nov 19 20:00:02.681197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1781/3611] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:02 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:03.697561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:03.698170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:03.705530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:03.706001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:03.706793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:03.707226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:03.776364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:03.785545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2aa7f956-b0fd-410e-b150-7d7437645036 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.091864 Nov 19 20:00:03.786117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1831/3612] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:03 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:04.804253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:04.804892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:04.811460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:04.811906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:04.812683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:04.813112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:04.880146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:04.890425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eb8c28b9-ba25-4945-bbea-0c8cbf1b4680 tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090460 Nov 19 20:00:04.891016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1782/3613] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:04 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:05.908988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:05.909634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:05.916543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:05.916991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:05.917797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:05.918242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:05.987032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:05.995371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-759c7a06-91be-4fb9-ade0-e152b49848cc tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.090130 Nov 19 20:00:05.995947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1832/3614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:05 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:07.014573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:07.015225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:07.027624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:07.028387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:07.030025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:07.030716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:07.108305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:07.116548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-429e90cf-d4c8-4cc2-ab70-356153a697ea tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1352 microversion: 2.1 time: 0.107029 Nov 19 20:00:07.117101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1783/3615] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:07 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:07.332565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "48a67d7b-f953-41df-8fae-0821524a8062"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:07.333718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:07.350424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:07.351499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:07.356095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:07.356868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:07.867329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-94d3657a-bac6-4b87-ad0d-7598433b8df6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.539049 Nov 19 20:00:07.870694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1833/3616] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 20:00:07 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 194 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:00:08.133453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:08.134118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:08.141121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.141644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.143163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.143622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.181739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.182233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.182802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lazy-loading 'fault' on Instance uuid 38904995-d04e-4db1-93b4-52153ee2c2e2 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:00:08.233188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc51618f63694c8bab3ab1ea8ce03c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffc5b6a5df1040c9849b724924b751bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:08.240638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d620615b-2f1f-46b5-93e9-2744446c600b tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 200 len: 1446 microversion: 2.1 time: 0.110891 Nov 19 20:00:08.241231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1784/3617] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:08 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:08.427688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:08.428305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:08.435479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.435915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.436693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.437118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.466853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 20:00:08.552060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43a9c841-4dc1-4447-a37a-5cc8ad608b6d tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "DELETE /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 204 len: 0 microversion: 2.1 time: 0.129876 Nov 19 20:00:08.552987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1834/3618] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:00:08 2021] DELETE /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 20:00:08.561048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:08.561691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:08.569762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.570254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.571099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.571472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.628624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:08.629256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:08.635575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.636025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.636822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.637254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.662778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lazy-loading 'flavor' on Instance uuid 048fc7ab-35b3-4b67-b7a4-05c90e948688 {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:00:08.709374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:08.718284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f735935f-b50e-49b1-95c2-f40d618478a2 tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1513 microversion: 2.1 time: 0.160630 Nov 19 20:00:08.718701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1785/3619] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:08 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:08.930694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a8802463-42a7-4916-81ff-3fa077fddab9 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 202 len: 0 microversion: 2.20 time: 0.306132 Nov 19 20:00:08.931476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1835/3620] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 20:00:08 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 20:00:08.939794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:08.940442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:08.947466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.947920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:08.948710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:08.949149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:09.096983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:09.105312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:09.106895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:09.108066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5405c634-d1da-4299-a4a8-8e185c63aba5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.172137 Nov 19 20:00:09.108622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1786/3621] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:08 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:09.260528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:09.261224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] [instance: 38904995-d04e-4db1-93b4-52153ee2c2e2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:09.268274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:09.268726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:09.269549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:09.269976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:09.285525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] HTTP exception thrown: Instance 38904995-d04e-4db1-93b4-52153ee2c2e2 could not be found. Nov 19 20:00:09.286128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] Returning 404 to user: Instance 38904995-d04e-4db1-93b4-52153ee2c2e2 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:00:09.286950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-97f33a24-d0a0-4af9-95b8-b2e2bedd436e tempest-ServerRescueNegativeTestJSON-127820948 tempest-ServerRescueNegativeTestJSON-127820948-project] 10.222.0.46 "GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2" status: 404 len: 111 microversion: 2.1 time: 0.031285 Nov 19 20:00:09.287506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1836/3622] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:09 2021] GET /compute/v2.1/servers/38904995-d04e-4db1-93b4-52153ee2c2e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:00:09.735966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:09.736656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:09.743568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:09.744084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:09.744793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:09.745216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:09.882757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:09.891570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cd579896-d602-432a-9b44-5b0c6a37f0fa tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1513 microversion: 2.1 time: 0.159134 Nov 19 20:00:09.892179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1787/3623] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:09 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:10.127570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:10.128246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:10.134444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:10.134899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:10.135863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:10.136315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:10.277922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:10.285899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:10.287459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:10.288605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-84c27716-a665-4d56-8ba5-3b4f459e1b63 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.166085 Nov 19 20:00:10.289152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1837/3624] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:10 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:10.908861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:10.909497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:10.916487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:10.916950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:10.917745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:10.918220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:11.209894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:11.217959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9e75c15-aa82-4192-b3c2-2bbcbbedb29f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1513 microversion: 2.1 time: 0.313077 Nov 19 20:00:11.218825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1788/3625] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:10 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:11.311562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:11.313482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:11.337456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:11.344221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:11.345220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:11.345759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:11.704302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:11.714387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:11.715990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:11.717265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a59b102b-32d0-4fce-b353-64b17c6fd043 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.413185 Nov 19 20:00:11.717829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1838/3626] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:11 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:12.090252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1147880234", "imageRef": "2cdb133a-690a-477f-a13e-78353fc85c89", "flavorRef": "452", "networks": [{"uuid": "f1cdaedb-a1f8-428f-bcba-cc1d26efc01c"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:12.150851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] validate_networks() for [('f1cdaedb-a1f8-428f-bcba-cc1d26efc01c', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 20:00:12.236547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:12.237186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:12.243687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:12.244206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:12.245018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:12.245452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:12.657698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4df88e053d6049e9bee5470199b7295d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf4fd88b35e44dd7b34a67f1eb62db5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:12.680979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7faf63fb-2f10-4bec-8926-d2baedb0878f tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 200 len: 1513 microversion: 2.1 time: 0.444259 Nov 19 20:00:12.682024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1839/3627] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:12 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 1513 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:12.748014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:12.748188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:12.758357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:12.758883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:12.759867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:12.760302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:13.413243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:13.422076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:13.424023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:13.425984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-beb8675e-8c19-490c-b747-7a405b5c7272 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.690923 Nov 19 20:00:13.426261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 20:00:13.426735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 20:00:13.429352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 20:00:13.432240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 20:00:13.432870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 20:00:13.438754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1840/3628] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:12 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:13.459542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:13.460100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:13.462096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:13.464421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:13.531774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Getting quotas for project f61b72e190f44f579af38f0dd53b9677. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 20:00:13.542282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Getting quotas for user 3d3462073007465e9154b15c23f8cddf and project f61b72e190f44f579af38f0dd53b9677. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 20:00:13.574302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 20:00:13.589304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2cdb133a-690a-477f-a13e-78353fc85c89',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 20:00:13.662482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa05ec60-a9cd-4d57-8583-308243c03e2c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.576162 Nov 19 20:00:13.667891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1789/3629] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 20:00:12 2021] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 20:00:13.674013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9794dd7f-a1a5-45ee-86ad-38ee29a455ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:13.674767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-0d0f3195-29f0-46fe-a657-46c74ef0fee7 req-1997aadf-403e-4d20-8884-543117e6498a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb9a8b1e-63df-4ecb-b090-cc77517dac92", "name": "network-vif-deleted", "tag": "ea619087-b804-4ac0-bda5-f98356052e0f"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:13.675357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9794dd7f-a1a5-45ee-86ad-38ee29a455ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:13.677038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:00:13.677038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:00:13.705361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-0d0f3195-29f0-46fe-a657-46c74ef0fee7 req-1997aadf-403e-4d20-8884-543117e6498a service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:13.706295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-0d0f3195-29f0-46fe-a657-46c74ef0fee7 req-1997aadf-403e-4d20-8884-543117e6498a service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:13.753771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-0d0f3195-29f0-46fe-a657-46c74ef0fee7 req-1997aadf-403e-4d20-8884-543117e6498a service nova] Creating event network-vif-deleted:ea619087-b804-4ac0-bda5-f98356052e0f for instance cb9a8b1e-63df-4ecb-b090-cc77517dac92 on hv-cinder-77703 Nov 19 20:00:13.759680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-0d0f3195-29f0-46fe-a657-46c74ef0fee7 req-1997aadf-403e-4d20-8884-543117e6498a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.319124 Nov 19 20:00:13.760241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1841/3630] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:00:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:13.765113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:13.765905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] [instance: cb9a8b1e-63df-4ecb-b090-cc77517dac92] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:13.773638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:13.774323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:13.775369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:13.777084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:13.790915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9794dd7f-a1a5-45ee-86ad-38ee29a455ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:13.800283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] HTTP exception thrown: Instance cb9a8b1e-63df-4ecb-b090-cc77517dac92 could not be found. Nov 19 20:00:13.800899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] Returning 404 to user: Instance cb9a8b1e-63df-4ecb-b090-cc77517dac92 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:00:13.801064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9794dd7f-a1a5-45ee-86ad-38ee29a455ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1219 microversion: 2.1 time: 0.131098 Nov 19 20:00:13.802029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1790/3631] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:13 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:13.802327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-378f5f7b-4ddf-4267-a0df-8c0dbf5c59da tempest-AttachVolumeNegativeTest-1392793711 tempest-AttachVolumeNegativeTest-1392793711-project] 10.222.0.46 "GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92" status: 404 len: 111 microversion: 2.1 time: 0.040698 Nov 19 20:00:13.803152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1842/3632] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:13 2021] GET /compute/v2.1/servers/cb9a8b1e-63df-4ecb-b090-cc77517dac92 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:00:14.447002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:14.448966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:14.460187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:14.460920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:14.461926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:14.462555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:14.719215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:14.728536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:14.730311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:14.731635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2cf2d891-ab21-4a79-b063-0fc042eafaf6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.289379 Nov 19 20:00:14.732297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1791/3633] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:14 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:14.820178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:14.820784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:14.827309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:14.828058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:14.829043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:14.829635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:14.906579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:14.917990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-947916a3-6cc1-42ba-97e6-a0bab0d514bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1271 microversion: 2.1 time: 0.101968 Nov 19 20:00:14.918611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1843/3634] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1271 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:15.750088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:15.750940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:15.761582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:15.762832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:15.766276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:15.766891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:15.798488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-9eba93a5-ca49-4d1d-a983-1d1d2ac08081 req-370e89d9-7329-4d4d-a74e-99603e029dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e13558fb-6c01-4fec-8683-7cf251c8e43e", "name": "network-vif-deleted", "tag": "831c9419-7682-4f8b-8024-53d869ac69e1"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:15.801127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:00:15.801127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:00:15.809952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-9eba93a5-ca49-4d1d-a983-1d1d2ac08081 req-370e89d9-7329-4d4d-a74e-99603e029dee service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:15.811139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-9eba93a5-ca49-4d1d-a983-1d1d2ac08081 req-370e89d9-7329-4d4d-a74e-99603e029dee service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:15.830208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-9eba93a5-ca49-4d1d-a983-1d1d2ac08081 req-370e89d9-7329-4d4d-a74e-99603e029dee service nova] Creating event network-vif-deleted:831c9419-7682-4f8b-8024-53d869ac69e1 for instance e13558fb-6c01-4fec-8683-7cf251c8e43e on hv-cinder-77703 Nov 19 20:00:15.836501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-9eba93a5-ca49-4d1d-a983-1d1d2ac08081 req-370e89d9-7329-4d4d-a74e-99603e029dee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042106 Nov 19 20:00:15.838234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1844/3635] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:00:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:00:15.937234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:15.939437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:15.947764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:15.948255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:15.949457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:15.950090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:16.095193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:16.105285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:16.106937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:16.108380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-533823e3-3d08-4cf1-ab00-03f66c2a8845 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.362069 Nov 19 20:00:16.109146 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1792/3636] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:15 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:16.217090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:16.231564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61a39bbd-c147-4f36-9e99-13eca79a3294 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.299212 Nov 19 20:00:16.233466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1845/3637] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:15 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:17.131018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:17.132104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:17.140813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:17.142102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:17.143254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:17.143724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:17.258177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:17.258894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:17.268463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:17.269207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:17.271133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:17.273009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:17.473161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:17.493829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:17.502886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:17.507511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5096dcbe-099d-4799-be35-7a661a75bf01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.381116 Nov 19 20:00:17.510809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1793/3638] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:17 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:17.559938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:17.570259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ff679fa-e9ab-4294-850c-0eef80904998 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.323514 Nov 19 20:00:17.575306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1846/3639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:17 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:17.890785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-ec79a03d-5c69-4dcb-abf7-45732626e333 req-cb484f8d-b200-4d56-aef7-780deb34a833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55b5c82-d731-4c63-aa4f-3ba1a695dee4", "tag": "40d74c88-0870-43ff-b0ec-f8f15e67e8e3"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:17.892764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:00:17.892764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 20:00:17.904538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-ec79a03d-5c69-4dcb-abf7-45732626e333 req-cb484f8d-b200-4d56-aef7-780deb34a833 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:17.904538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-ec79a03d-5c69-4dcb-abf7-45732626e333 req-cb484f8d-b200-4d56-aef7-780deb34a833 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:17.921490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-ec79a03d-5c69-4dcb-abf7-45732626e333 req-cb484f8d-b200-4d56-aef7-780deb34a833 service nova] Creating event network-changed:40d74c88-0870-43ff-b0ec-f8f15e67e8e3 for instance d55b5c82-d731-4c63-aa4f-3ba1a695dee4 on hv-cinder-77703 Nov 19 20:00:17.929175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-ec79a03d-5c69-4dcb-abf7-45732626e333 req-cb484f8d-b200-4d56-aef7-780deb34a833 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042415 Nov 19 20:00:17.929805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1794/3640] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:00:17 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:18.533771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:18.534634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:18.541807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.542361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.543145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.543572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.590607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:18.591324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:18.604209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.608114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.608958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.612260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.786677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:18.799338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:18.801648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:18.803116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7f363d10-b833-4235-b20d-bf428c203f01 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.276420 Nov 19 20:00:18.804753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1847/3641] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:18 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:18.811868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:18.813012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:18.822290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.822967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.823967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.824590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.861614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:18.874254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d079a23a-2ee6-46a2-a647-2ab38b9faf89 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067759 Nov 19 20:00:18.874865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1848/3642] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:00:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:18.875414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c39cb53-46d8-412d-8f0a-9d2ec2f1f41b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.289755 Nov 19 20:00:18.876275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1795/3643] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:18 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:18.884801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:18.885292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:18.892196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.893538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.894079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:18.894586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:18.927881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc5fa7a7-4a4a-42a6-bc91-7239a97b45e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/48a67d7b-f953-41df-8fae-0821524a8062" status: 200 len: 194 microversion: 2.1 time: 0.046605 Nov 19 20:00:18.928412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1849/3644] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Nov 19 20:00:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/48a67d7b-f953-41df-8fae-0821524a8062 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:19.825301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:19.826418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:19.835858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:19.836474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:19.837618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:19.838683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:19.895048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:19.896135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:19.904267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:19.904988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:19.905904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:19.906481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:20.109710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:20.119444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:20.123686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:20.128907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:20.130224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b3be532-cfb4-4c78-8e15-29dda48b4000 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.311156 Nov 19 20:00:20.130840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1796/3645] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:19 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:20.135143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-54d620f4-373e-48f9-9f13-0c01fb5cf0bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.245357 Nov 19 20:00:20.135698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1850/3646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:20.421983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "522d6661-ad2f-4b7f-b22a-ab93ef8eeba3"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:20.423086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:20.434840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:20.435600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:20.436469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:20.442726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:20.790709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7b2ef86-1fa7-4225-bd9c-7249aa2f56e5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372345 Nov 19 20:00:20.791744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1797/3647] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 20:00:20 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:21.152732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:21.153405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:21.162809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:21.164209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:21.170830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:21.171357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:21.172055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:21.172742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:21.176589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:21.177078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:21.177838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:21.180625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:21.465722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:21.496109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:21.496419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:21.498422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:21.505059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e45eed63-1475-4317-b5e5-036ba4238e9a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.356030 Nov 19 20:00:21.506478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1851/3648] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:21.507905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-69e34519-6eb5-4197-a3bb-b44ef9294cce tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.351935 Nov 19 20:00:21.511421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1798/3649] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:21 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:22.525387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:22.525387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:22.530614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:22.531197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:22.531358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:22.531672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:22.532426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:22.533312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:22.538461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:22.538973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:22.539776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:22.540211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:22.737956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:22.745896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:22.748246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8f5ea65-ac0e-491c-8dd1-e5d98b2cf18a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.227947 Nov 19 20:00:22.758038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:22.758038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:22.759016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1852/3650] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:22 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:22.759369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-35c3480e-4603-40dd-9ce6-9d10c5c97080 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.232642 Nov 19 20:00:22.759909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1799/3651] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:22 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:23.764976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:23.765819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:23.772526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:23.778032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:23.778797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:23.787031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:23.787512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:23.788471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:23.788758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:23.791645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:23.792881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:23.793332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:24.011200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:24.016273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:24.021860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:24.023862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:24.025071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-20a29318-d181-4a1a-9d72-dc820f8078a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.251097 Nov 19 20:00:24.025266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1112bc3a-516b-4c31-909f-c53aeb65af43 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.264240 Nov 19 20:00:24.025645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1800/3652] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:23 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:24.026223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1853/3653] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:23 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:25.042704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:25.043360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:25.043923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:25.044505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:25.051056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:25.051341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:25.051569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:25.051751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:25.052360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:25.052568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:25.052815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:25.053134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:25.260821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:25.264694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:25.271643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-99e8f83e-8343-4bc7-b1df-1c72e97d40d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.232882 Nov 19 20:00:25.272959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1801/3654] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:25 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:25.284610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:25.286410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:25.287761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b8e2220e-fa0f-4727-977e-fe9f342271df tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1746 microversion: 2.20 time: 0.247530 Nov 19 20:00:25.288388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1854/3655] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:25 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1746 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:26.207803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-277f61d0-a573-4994-b957-210932f11ea8 req-d2ac1e16-1637-4d9d-b1ef-bb126a44a387 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55b5c82-d731-4c63-aa4f-3ba1a695dee4", "name": "network-vif-plugged", "status": "completed", "tag": "40d74c88-0870-43ff-b0ec-f8f15e67e8e3"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:26.209381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:00:26.209381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 20:00:26.217139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-277f61d0-a573-4994-b957-210932f11ea8 req-d2ac1e16-1637-4d9d-b1ef-bb126a44a387 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:26.217571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-277f61d0-a573-4994-b957-210932f11ea8 req-d2ac1e16-1637-4d9d-b1ef-bb126a44a387 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:26.229938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-277f61d0-a573-4994-b957-210932f11ea8 req-d2ac1e16-1637-4d9d-b1ef-bb126a44a387 service nova] Creating event network-vif-plugged:40d74c88-0870-43ff-b0ec-f8f15e67e8e3 for instance d55b5c82-d731-4c63-aa4f-3ba1a695dee4 on hv-cinder-77703 Nov 19 20:00:26.235342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-277f61d0-a573-4994-b957-210932f11ea8 req-d2ac1e16-1637-4d9d-b1ef-bb126a44a387 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170779 Nov 19 20:00:26.236096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1802/3656] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:00:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:00:26.291090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:26.292161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:26.299778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:26.300226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:26.301014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:26.301499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:26.309783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:26.310966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:26.323657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:26.324723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:26.326656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:26.327671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:26.639923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:26.650477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:26.666137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c90dd8df-2da8-4f2f-9fff-02a614447de9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.378999 Nov 19 20:00:26.667195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1855/3657] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:26 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:00:26.670196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:26.671815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:26.672989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d49f982a-7adb-4f84-bfd1-8b895985311d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.368053 Nov 19 20:00:26.673708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1803/3658] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:26 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:27.683547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:27.685061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:27.693515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:27.693827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:27.694408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:27.694517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:27.695213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:27.695848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:27.703576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:27.704287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:27.707583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:27.708900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:28.014766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:28.023853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-177d6427-00c6-4cf8-9b86-b3718b1b593d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1319 microversion: 2.1 time: 0.344431 Nov 19 20:00:28.027196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1856/3659] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:28.089474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:28.099850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:28.102299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:28.103631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cb750b4d-4480-421e-9933-e9070b9b9a0b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.413538 Nov 19 20:00:28.104666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1804/3660] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:27 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:28.282186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-13a53a71-315c-4fac-b661-706bd9ac0d11 req-7ee1e222-3a09-4c92-8e89-24232828f3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "name": "network-vif-plugged", "status": "completed", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:28.283925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:00:28.283925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:00:28.296277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-13a53a71-315c-4fac-b661-706bd9ac0d11 req-7ee1e222-3a09-4c92-8e89-24232828f3aa service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:28.298712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-13a53a71-315c-4fac-b661-706bd9ac0d11 req-7ee1e222-3a09-4c92-8e89-24232828f3aa service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:28.327015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-13a53a71-315c-4fac-b661-706bd9ac0d11 req-7ee1e222-3a09-4c92-8e89-24232828f3aa service nova] Creating event network-vif-plugged:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 20:00:28.342584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-13a53a71-315c-4fac-b661-706bd9ac0d11 req-7ee1e222-3a09-4c92-8e89-24232828f3aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064117 Nov 19 20:00:28.343214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1857/3661] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:00:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:29.042904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:29.044193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:29.052051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:29.053033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:29.054072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:29.054753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:29.126343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:29.127672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:29.147832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:29.148285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:29.149078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:29.149509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:29.305525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:29.314745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c24f58bf-7bef-4af0-b084-a30eca6fd439 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1509 microversion: 2.1 time: 0.275424 Nov 19 20:00:29.315567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1805/3662] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:00:29 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:00:29.335101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91375ef6-4210-485a-933d-7dfd458bf24f", "device": "/dev/sdb"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:29.338346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:29.345893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:29.347856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:29.348960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:29.349758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:29.448831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:29.449461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:29.456262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:29.457753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a87d4180-8ab6-446b-b88e-17604f8bd85d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.335970 Nov 19 20:00:29.461218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1858/3663] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:29 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:29.737928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2cc84985-ebcd-4804-bb55-e1b6d927ad38 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "POST /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406237 Nov 19 20:00:29.743681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1806/3664] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 20:00:29 2021] POST /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:30.481239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:30.481930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:30.489724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:30.490198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:30.491018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:30.491454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:30.703430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:30.719209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:30.721377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:30.723015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-64de9d0f-5861-4488-b19f-d17498d5aad3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.245866 Nov 19 20:00:30.735304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1859/3665] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:30 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:31.733109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:31.734334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:31.742899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:31.744150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:31.753460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:31.757578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:31.758506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:31.759328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:31.759761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:31.763391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:31.764173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:31.764817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:31.850773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e65772d-2e47-49c5-acf1-7d94d16d67bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.122653 Nov 19 20:00:31.866595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1807/3666] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:00:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 371 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:31.980183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:31.990099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:31.992551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:31.995350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d2fc861a-5933-4a47-bbde-bf8a85106199 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.256307 Nov 19 20:00:31.997531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1860/3667] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:31 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:32.141540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:32.144631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:32.155276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:32.155943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:32.157000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:32.157842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:32.199807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e199ca23-a20a-49a4-9431-79af2a932c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/48a67d7b-f953-41df-8fae-0821524a8062" status: 200 len: 194 microversion: 2.1 time: 0.068607 Nov 19 20:00:32.200444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1808/3668] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Nov 19 20:00:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/48a67d7b-f953-41df-8fae-0821524a8062 => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:32.211741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:32.212531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:32.225875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:32.226653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:32.228974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:32.232231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:32.355219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lazy-loading 'services' on Instance uuid e9233030-c878-4eef-a231-13ba34eae0c2 {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:00:32.463485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-89fa9141-458d-4f12-9439-fd1bf7c7300a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/48a67d7b-f953-41df-8fae-0821524a8062" status: 202 len: 0 microversion: 2.1 time: 0.253112 Nov 19 20:00:32.464792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1861/3669] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 20:00:32 2021] DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/48a67d7b-f953-41df-8fae-0821524a8062 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:00:33.018828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:33.023060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:33.039414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:33.040854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:33.043205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:33.044286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:33.240823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:33.276150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:33.281340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:33.283761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-164914c9-ce1d-4038-9a8f-124b70227c32 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.270464 Nov 19 20:00:33.284585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1809/3670] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:33 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 19 20:00:34.303533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:34.304244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:34.319276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:34.319873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:34.323163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:34.325538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:34.574216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:34.583635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:34.587550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:34.589883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a4660e9-aed4-481e-b027-50ff795a80fc tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.290683 Nov 19 20:00:34.605932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1862/3671] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:34 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:35.613030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:35.614420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:35.644365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:35.646089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:35.647095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:35.647678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:36.335088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:36.348735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:36.366584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:36.369206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bf077eea-2fc1-4253-b871-d9c090a2f851 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.759046 Nov 19 20:00:36.370619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1810/3672] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:35 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:37.388076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:37.388684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:37.397041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:37.397774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:37.398776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:37.399398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:37.625466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:37.634639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:37.636465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:37.637873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d45518a7-9d5e-466a-84f9-7cffa074ac64 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.253355 Nov 19 20:00:37.638494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1863/3673] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:37 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:38.664705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:38.665426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:38.673282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:38.673987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:38.674964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:38.675566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:38.863885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:38.871890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:38.873349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:38.874545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-627759fc-c79a-4d1e-99cb-e7c076ebaa8c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.222199 Nov 19 20:00:38.875095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1811/3674] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:38 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:39.896598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:39.897228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:39.906208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:39.906795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:39.907931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:39.908838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:40.051457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:40.060286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:40.061788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:40.062986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46f99d1f-befa-4939-a95d-9a254f6fd07e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.172544 Nov 19 20:00:40.063546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1864/3675] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:39 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:41.081303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:41.081907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:41.089265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:41.089715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:41.090535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:41.090965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:41.241268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:41.250399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:41.251899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:41.253379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8d15e950-e26c-4fb0-985d-164726a909ad tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1741 microversion: 2.20 time: 0.176250 Nov 19 20:00:41.254312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1812/3676] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:41 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:42.274827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:42.275743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:42.285313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:42.285764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:42.286583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:42.287021 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:42.432242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:42.441217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:42.442810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:42.444167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a0e5a150-bf7c-4600-9e2f-a09ba5871cd5 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1723 microversion: 2.20 time: 0.175106 Nov 19 20:00:42.444691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1865/3677] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:42 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:43.462520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:43.463494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:43.469973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:43.470584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:43.471360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:43.471868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:43.630587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:43.639358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:43.640836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:43.642001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3e0cea07-3b82-468b-a52f-63b39f0f9367 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1723 microversion: 2.20 time: 0.183073 Nov 19 20:00:43.642612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1813/3678] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:43 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:44.661083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:44.661676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:44.668499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:44.668940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:44.669709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:44.670168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:44.815171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:44.824542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:44.826068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:44.827219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8128aa49-e34b-4a20-8373-366f0857fe1f tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1723 microversion: 2.20 time: 0.169865 Nov 19 20:00:44.827788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1866/3679] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:44 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:45.560855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:45.561433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:45.567481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:45.567957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:45.568746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:45.569179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:45.601367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6f3fc29a-3479-4ab2-8284-6558d30fed4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/522d6661-ad2f-4b7f-b22a-ab93ef8eeba3" status: 200 len: 194 microversion: 2.1 time: 0.044538 Nov 19 20:00:45.601994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1814/3680] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Nov 19 20:00:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/522d6661-ad2f-4b7f-b22a-ab93ef8eeba3 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:45.611482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:45.611972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:45.618366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:45.618806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:45.619563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:45.619992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:45.703351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lazy-loading 'services' on Instance uuid e9233030-c878-4eef-a231-13ba34eae0c2 {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:00:45.786120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e5076034-113f-41bd-93c9-8ed50c49cd3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/522d6661-ad2f-4b7f-b22a-ab93ef8eeba3" status: 202 len: 0 microversion: 2.1 time: 0.178055 Nov 19 20:00:45.787201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1867/3681] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 20:00:45 2021] DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments/522d6661-ad2f-4b7f-b22a-ab93ef8eeba3 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:00:45.844938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:45.845539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:45.851979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:45.852429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:45.853257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:45.853723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:46.002380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:46.011562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:46.013028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:46.014230 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-32013415-9a2b-4527-857c-6f9f2054681c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1723 microversion: 2.20 time: 0.172967 Nov 19 20:00:46.014793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1815/3682] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:45 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:47.038860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:47.039544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:47.045888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:47.046386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:47.047227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:47.047668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:47.199500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:47.208492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:47.209896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:47.211158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ed508900-840c-4145-9455-a7cc53d08e79 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1723 microversion: 2.20 time: 0.177327 Nov 19 20:00:47.211734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1868/3683] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:47 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:48.230579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:48.231239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:48.237990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:48.238552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:48.239314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:48.239772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:48.403063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:48.413003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:48.414817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:48.416194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81326c23-eba2-47e8-8486-a98d72c49aa1 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1723 microversion: 2.20 time: 0.189985 Nov 19 20:00:48.416846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1816/3684] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:48 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:48.444237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-c1eb353e-f61e-4a26-8ee5-850e6240321e req-c0373a35-861c-4ca4-8b3d-82cb97b214ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "name": "network-vif-unplugged", "status": "completed", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:48.445870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:00:48.445870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:00:48.453969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-c1eb353e-f61e-4a26-8ee5-850e6240321e req-c0373a35-861c-4ca4-8b3d-82cb97b214ed service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:48.454567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-c1eb353e-f61e-4a26-8ee5-850e6240321e req-c0373a35-861c-4ca4-8b3d-82cb97b214ed service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:48.467710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-c1eb353e-f61e-4a26-8ee5-850e6240321e req-c0373a35-861c-4ca4-8b3d-82cb97b214ed service nova] Creating event network-vif-unplugged:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 20:00:48.472713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-c1eb353e-f61e-4a26-8ee5-850e6240321e req-c0373a35-861c-4ca4-8b3d-82cb97b214ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032403 Nov 19 20:00:48.473320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1869/3685] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:00:48 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:00:49.435798 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:49.436393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:49.443566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:49.444019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:49.444800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:49.445228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:49.594865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:49.603123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:49.604594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:49.605755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-616d19fa-77f1-474f-a6aa-92efa06e6728 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1666 microversion: 2.20 time: 0.173732 Nov 19 20:00:49.606365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1817/3686] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:49 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1666 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:49.624459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7e31c66c-3ca5-4313-b114-b6fd648ad794"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:49.625673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:49.632920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:49.633358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:49.634305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:49.634735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:49.928006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5159fa9-fe5f-49d8-9d06-730839fa1a11 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307729 Nov 19 20:00:49.928627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1870/3687] 10.222.0.46 () {62 vars in 1363 bytes} [Fri Nov 19 20:00:49 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-volume_attachments => generated 188 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 19 20:00:50.078229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:50.078712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:50.084845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:50.085294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:50.086084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:50.086524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:50.328505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e2cce84-4f8a-41cf-b3f3-aede044026a8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-volume_attachments/7e31c66c-3ca5-4313-b114-b6fd648ad794" status: 202 len: 0 microversion: 2.20 time: 0.253983 Nov 19 20:00:50.329086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1818/3688] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Nov 19 20:00:50 2021] DELETE /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-volume_attachments/7e31c66c-3ca5-4313-b114-b6fd648ad794 => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 19 20:00:50.386761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:00:50.387531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:50.397062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:50.397508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:50.398737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:50.399362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:50.606217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e464924d-be4f-4676-a0d7-d5c7639cf5cb tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action" status: 202 len: 0 microversion: 2.20 time: 0.226266 Nov 19 20:00:50.611165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1871/3689] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Nov 19 20:00:50 2021] POST /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 19 20:00:50.617273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:50.617968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:50.625094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:50.625550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:50.626379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:50.626788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:50.767376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:50.776347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:50.777968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:50.779170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5764a5d-15c1-4ef6-8c66-58adaa5dd321 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1674 microversion: 2.20 time: 0.166284 Nov 19 20:00:50.779718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1819/3690] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:50 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:51.798210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:51.798842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:51.805743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:51.806224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:51.806989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:51.807389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:51.956154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:51.965034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:51.966532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:51.967766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-90cd6c2e-eb6f-4398-858d-21f719115e81 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.173449 Nov 19 20:00:51.968366 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1872/3691] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:51 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:52.986923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:52.987557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:52.994628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:52.995081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:52.995868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:52.996307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:53.152636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:53.171113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:53.179079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:53.180716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3b954c1-d5b6-4a9d-81be-63bdca8ddf31 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.197169 Nov 19 20:00:53.181178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1820/3692] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:52 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:54.199675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:54.200417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:54.207558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:54.208005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:54.209804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:54.218140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:54.382432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:54.390800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:54.392271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:54.393475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d05ef565-94ee-4b6d-916b-c74ad841a764 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.197636 Nov 19 20:00:54.394075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1873/3693] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:54 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:55.412209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:55.412898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:55.419415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:55.419865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:55.420664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:55.421093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:55.580070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:55.589559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:55.591047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:55.592210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ecbf886a-5293-4611-b3ae-77f540d1fb5b tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.183865 Nov 19 20:00:55.592758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1821/3694] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:55 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:56.610881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:56.611557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:56.619763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:56.620189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:56.620983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:56.621415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:56.770457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:56.779067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:56.780551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:56.781715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-226eefe7-2541-4599-8ad5-91880a36f681 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.174787 Nov 19 20:00:56.782520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1874/3695] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:56 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:57.801071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:57.801662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:57.809485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:57.810157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:57.811012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:57.811705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:57.960298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:57.969250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:57.970793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:57.972007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-55701d75-e8eb-49c1-9dd3-b2ee207c3357 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.175501 Nov 19 20:00:57.973764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1822/3696] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:57 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:00:58.993108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:00:58.994168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:00:59.000402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:59.000953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:59.001833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:00:59.002367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:00:59.175231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:59.183719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:59.185204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:00:59.186436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-18b7e736-6753-41f4-bdc7-6986c56acf9c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.197652 Nov 19 20:00:59.187007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1875/3697] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:00:58 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:00.205108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:00.206170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:00.213822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:00.214382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:00.215257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:00.215682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:00.372446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:00.381051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:00.382680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:00.383867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e6889486-a819-497b-8fd6-345481beeb60 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.182763 Nov 19 20:01:00.384452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1823/3698] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:00 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:01.403105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:01.403835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:01.410562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:01.411018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:01.411804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:01.412262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:01.572333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:01.583756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:01.585951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:01.587187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-284702a4-08c8-450b-a8c5-655970d890cd tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.188081 Nov 19 20:01:01.588106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1876/3699] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:01 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:02.612906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:02.613591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:02.621329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:02.621843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:02.622660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:02.623327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:02.809918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:02.818213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:02.819722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:02.820938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-17fc4335-40eb-4118-943a-77fd41f4c411 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.212005 Nov 19 20:01:02.821504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1824/3700] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:02 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:03.840108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:03.840686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:03.847758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:03.848303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:03.849528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:03.850252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:03.996905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:04.009610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:04.011857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:04.013612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bae79a2c-efca-4128-aaed-306a9e1157c7 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.177316 Nov 19 20:01:04.014458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1877/3701] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:03 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:05.038658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:05.039524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:05.047538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:05.047988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:05.048780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:05.049219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:05.203710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:05.212386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:05.214312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:05.215485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f16cd873-78b9-44a5-92b0-8fc9f215a25c tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.180770 Nov 19 20:01:05.216022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1825/3702] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:05 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:06.234989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:06.235625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:06.242930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:06.243425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:06.244301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:06.244698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:06.392710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:06.401403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:06.402893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:06.404174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ce59d05e-bb6b-47fa-b9c4-9f3e87033bc6 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.173942 Nov 19 20:01:06.404760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1878/3703] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:06 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:07.422823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:07.423553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:07.430496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:07.430935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:07.431724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:07.432141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:07.574683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:07.583169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:07.584647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:07.585800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-af47efe2-3569-4459-ad5e-54fa2a254eaa tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.166771 Nov 19 20:01:07.586549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1826/3704] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:07 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:08.548743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-61e0517f-8099-439f-abaf-814a5f9fb995 req-c33ff4f5-dc62-4dcb-8e6e-361203a6f859 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "name": "network-vif-plugged", "status": "completed", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:01:08.550474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:01:08.550474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:01:08.560339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-61e0517f-8099-439f-abaf-814a5f9fb995 req-c33ff4f5-dc62-4dcb-8e6e-361203a6f859 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:08.560837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-61e0517f-8099-439f-abaf-814a5f9fb995 req-c33ff4f5-dc62-4dcb-8e6e-361203a6f859 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:08.574419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-61e0517f-8099-439f-abaf-814a5f9fb995 req-c33ff4f5-dc62-4dcb-8e6e-361203a6f859 service nova] Creating event network-vif-plugged:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 20:01:08.580022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-61e0517f-8099-439f-abaf-814a5f9fb995 req-c33ff4f5-dc62-4dcb-8e6e-361203a6f859 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034952 Nov 19 20:01:08.580623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1879/3705] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:01:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:01:08.604469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:08.605853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:08.612248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:08.612964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:08.613931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:08.614420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:08.892883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:08.903118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:08.904675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:08.905892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0878dd1-2a16-4750-8486-f27f80acee08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.305803 Nov 19 20:01:08.906813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1827/3706] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:08 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:09.925154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:09.925834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:09.932908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:09.933325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:09.934133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:09.934558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:10.076838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:10.085379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:10.087030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:10.088743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2195e388-c740-4ea0-83d5-615f1ac1ce08 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1732 microversion: 2.20 time: 0.167629 Nov 19 20:01:10.089369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1880/3707] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:09 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:11.110832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:11.111441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:11.118309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:11.118763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:11.119627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:11.120073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:11.299747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:11.309493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:11.311202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:11.312370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74eb2ed4-03de-4b07-ac5e-69ba4e9a5c80 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1719 microversion: 2.20 time: 0.205354 Nov 19 20:01:11.312933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1828/3708] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:11 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1719 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:40.480078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:40.481023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:40.487348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:40.487794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:40.488781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:40.489213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:40.518647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8ebb1b3-ead8-4155-86e9-65260e83b8d2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042212 Nov 19 20:01:40.520766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1881/3709] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Nov 19 20:01:40 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:01:40.585254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:40.585821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:40.592789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:40.593288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:40.594021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:40.594481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:40.618886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 20:01:40.699273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8009de65-6926-4884-aee5-dc0066577454 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 204 len: 0 microversion: 2.20 time: 0.118110 Nov 19 20:01:40.700017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1829/3710] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Nov 19 20:01:40 2021] DELETE /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 20:01:40.708359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:40.709183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:40.715896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:40.716332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:40.717101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:40.717522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:40.936140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:40.945073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:40.946607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:40.947776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0cc4e07-c795-4b38-a347-e5774944adb8 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.243315 Nov 19 20:01:40.948326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1882/3711] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:40 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:41.970749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:41.971415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:41.980426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:41.981030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:41.982117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:41.982762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:42.146499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:42.155565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:42.157031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:42.158237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d2cd40f9-4aa0-4843-acba-6bc957b38de2 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1725 microversion: 2.20 time: 0.193392 Nov 19 20:01:42.159116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1830/3712] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:41 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:43.020152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-90b4457f-58e2-4953-b022-d4954b78a293 req-e021b5ac-7f8d-4642-8107-36caf399c63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "048fc7ab-35b3-4b67-b7a4-05c90e948688", "name": "network-vif-deleted", "tag": "66b92a0c-7661-43a1-9255-400a4aabac95"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:01:43.022872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:01:43.022872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:01:43.031312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-90b4457f-58e2-4953-b022-d4954b78a293 req-e021b5ac-7f8d-4642-8107-36caf399c63f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:43.031757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-90b4457f-58e2-4953-b022-d4954b78a293 req-e021b5ac-7f8d-4642-8107-36caf399c63f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:43.043917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-90b4457f-58e2-4953-b022-d4954b78a293 req-e021b5ac-7f8d-4642-8107-36caf399c63f service nova] Creating event network-vif-deleted:66b92a0c-7661-43a1-9255-400a4aabac95 for instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 on hv-cinder-77703 Nov 19 20:01:43.049065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-90b4457f-58e2-4953-b022-d4954b78a293 req-e021b5ac-7f8d-4642-8107-36caf399c63f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032794 Nov 19 20:01:43.049690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1883/3713] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:01:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:01:43.177464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:43.178223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:43.185877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:43.186855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:43.187740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:43.188247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:43.257557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:43.265645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:43.267157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:43.268312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b613dcc2-00f9-43d5-8461-26d35267a00d tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1367 microversion: 2.20 time: 0.095127 Nov 19 20:01:43.268886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1831/3714] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:43 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1367 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:44.288335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:44.289055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:44.295579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:44.296019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:44.296781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:44.297207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:44.370625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:44.379420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:44.381734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5416c05854a84428a3253dc8f373dce3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c347e63d053a44c0b82b72c18fcbad8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:01:44.383191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-455a1ddc-c8f7-420b-9b15-39916ca57491 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 200 len: 1367 microversion: 2.20 time: 0.099370 Nov 19 20:01:44.383920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1884/3715] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:44 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 1367 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 19 20:01:45.401694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:45.402291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:01:45.409053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:45.409502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:45.410329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:01:45.410768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:01:45.424701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 could not be found. Nov 19 20:01:45.425292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 404 to user: Instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:01:45.426189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ddd5a7b-5efa-475f-86a1-4c5a33c3f0a3 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 404 len: 111 microversion: 2.20 time: 0.028669 Nov 19 20:01:45.426700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1832/3716] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Nov 19 20:01:45 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 19 20:01:45.435419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fdb382f1-cdef-4526-bc7f-1d47e91e7c20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '.version_select at 0x7fc14c9829d0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:01:45.458607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fdb382f1-cdef-4526-bc7f-1d47e91e7c20 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115588660" status: 204 len: 0 microversion: 2.20 time: 0.026968 Nov 19 20:01:45.459181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1885/3717] 10.222.0.46 () {60 vars in 1261 bytes} [Fri Nov 19 20:01:45 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115588660 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 19 20:02:16.684167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:02:16.685097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:02:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:04:09.556115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:04:09.556829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:04:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:04:20.085735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:04:20.085735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:04:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:04:24.434693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:04:24.435459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:04:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:05:33.153766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:05:33.154432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:05:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:05:36.707649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:05:36.708188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:05:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:06:45.403827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55a27380-be4b-4b70-b3e6-9e8d488aa521] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Nov 19 20:06:45.407574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:45.409379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:45.415723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:45.416166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:45.416973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:45.417397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:45.447949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03887ddd-caff-4566-a336-dd9476fe11c6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045946 Nov 19 20:06:45.448546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1833/3718] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:46.353973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1764f5f-ae10-4a30-884d-113326187a0f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 19 20:06:46.357811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:46.358330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:46.367335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:46.367777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:46.368613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:46.368964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:46.459290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:46.460612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:46.477495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:46.477920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:46.478852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:46.479294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:46.498208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] [55a27380-be4b-4b70-b3e6-9e8d488aa521] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 34096. Nov 19 20:06:46.514316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3657083a-cd58-4ce8-9e92-0ed3e7a194f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058544 Nov 19 20:06:46.515115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1834/3719] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:06:46.523972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.objects.instance [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lazy-loading 'services' on Instance uuid d55b5c82-d731-4c63-aa4f-3ba1a695dee4 {{(pid=116111) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:06:46.644249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-55798d40-060a-47fa-abc5-017eecb6cc1a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4/os-volume_attachments/91375ef6-4210-485a-933d-7dfd458bf24f" status: 202 len: 0 microversion: 2.1 time: 0.291706 Nov 19 20:06:46.644845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1886/3720] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 20:06:46 2021] DELETE /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4/os-volume_attachments/91375ef6-4210-485a-933d-7dfd458bf24f => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:06:47.526194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:47.526991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:47.534536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:47.534979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:47.536027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:47.536589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:47.571200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-10a605e8-38e1-45ba-93a7-061d00ca3edb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048880 Nov 19 20:06:47.572447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1835/3721] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:48.595431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:48.596312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:48.607197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1764f5f-ae10-4a30-884d-113326187a0f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 34116. Nov 19 20:06:48.608949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:48.609396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:48.610758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:48.611261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:48.643607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b279e0cd-0390-424f-be03-813be8694003 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063610 Nov 19 20:06:48.644187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1887/3722] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:49.655474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:49.656413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:49.663335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:49.663785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:49.664594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:49.665028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:49.699055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-36de19f6-2a01-44e5-adfc-d7789da06b3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047554 Nov 19 20:06:49.699628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1836/3723] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:50.713082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:50.714089 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:50.721172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:50.721611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:50.722417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:50.722844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:50.753443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8b98ea72-243e-4d40-8844-d30fd66f5de6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046207 Nov 19 20:06:50.754022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1888/3724] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:51.766088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:51.767094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:51.774037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:51.774513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:51.775288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:51.775726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:51.806719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b9dac5c4-b2b5-4cd7-8704-b51531225947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044441 Nov 19 20:06:51.807277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1837/3725] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:52.822889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:52.823957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:52.831532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:52.832116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:52.832967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:52.833498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:52.865614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-672d5bb3-ddd2-48d9-897c-d4fa2adcc87a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048659 Nov 19 20:06:52.866195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1889/3726] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:53.878504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:53.879454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:53.886469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:53.886923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:53.887707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:53.888141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:53.921725 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4905eb24-1809-4fec-ae9e-89615ef68973 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Nov 19 20:06:53.922335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1838/3727] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:54.934382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:54.935325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:54.942298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:54.942759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:54.943542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:54.943975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:54.976039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95c98450-666a-4ecd-a88f-bfc7bc9cc946 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045460 Nov 19 20:06:54.976627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1890/3728] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:55.988557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:55.989458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:55.996356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:55.996809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:55.997583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:55.998016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:56.028714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1494f091-a3f3-49ef-b181-fdff2044d28b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044407 Nov 19 20:06:56.029268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1839/3729] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:57.044358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:57.045552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:57.055131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:57.055682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:57.056787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:57.057420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:57.090681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-341a283e-4f9e-4b8e-a9c5-ba5e26d55026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052496 Nov 19 20:06:57.091211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1891/3730] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:58.102643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:58.103547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:58.110156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:58.110608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:58.111378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:58.111807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:58.142873 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a171bbe9-3812-4b28-9857-55b56b2fbd96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Nov 19 20:06:58.143357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1840/3731] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:06:59.155256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:06:59.156659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:06:59.164612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:59.165056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:59.165900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:06:59.166410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:06:59.197062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83337802-e8cc-4a6f-b4fb-961b797c32e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045599 Nov 19 20:06:59.197615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1892/3732] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:06:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:00.208920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:00.210427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:00.217051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:00.217498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:00.218307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:00.218735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:00.249479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f89987f2-9335-4547-b98a-5712ba276ec7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Nov 19 20:07:00.250126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1841/3733] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:01.263208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:01.264029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:01.271181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:01.271632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:01.272434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:01.272873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:01.307138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b16a7f19-74a0-4f50-bb1a-52a177d15f4f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047436 Nov 19 20:07:01.307930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1893/3734] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:02.322283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:02.323196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:02.330031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:02.330517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:02.331303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:02.331736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:02.365608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ee1ebc6-8797-43ba-9a1b-9c3625f4fe87 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048128 Nov 19 20:07:02.366232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1842/3735] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:03.379636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:03.380541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:03.387689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:03.388120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:03.388887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:03.389317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:03.422133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d2712da2-6750-43cc-984b-9abca6eee2c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047413 Nov 19 20:07:03.422695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1894/3736] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:04.434677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:04.435746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:04.445175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:04.445802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:04.446916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:04.447495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:04.480739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f6bf999-bb77-4812-b14f-da9c6dca05ed tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050404 Nov 19 20:07:04.481487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1843/3737] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:05.493047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:05.493981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:05.500985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:05.501433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:05.502228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:05.502662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:05.534733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8b6eb48-5ab7-48f4-87f1-26d163c15ee7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045187 Nov 19 20:07:05.535345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1895/3738] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:06.547472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:06.548283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:06.555149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:06.555586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:06.556349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:06.556764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:06.591661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-168a159a-2c25-484f-8922-8904f9513dee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048025 Nov 19 20:07:06.592226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1844/3739] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:07.603742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:07.604629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:07.611602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:07.612051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:07.612820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:07.613250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:07.644354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a63fc3a2-ceac-477e-a77a-101cc07449f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Nov 19 20:07:07.644919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1896/3740] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:08.656465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:08.657376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:08.666036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:08.666903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:08.668130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:08.668854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:08.702250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-685bb3dc-2aa4-42e5-aee9-f19fa9754dff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049503 Nov 19 20:07:08.702818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1845/3741] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:09.714856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:09.715749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:09.722981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:09.723435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:09.724220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:09.724639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:09.756041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2bf57ff4-103e-4686-bc4a-f0190b89cab6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Nov 19 20:07:09.756612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1897/3742] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:10.768111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:10.769282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:10.776093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:10.776576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:10.777393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:10.777828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:10.808892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c1d88817-d49f-4cb9-bb8b-6e25fad4f5ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Nov 19 20:07:10.809439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1846/3743] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:11.821550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:11.822505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:11.829505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:11.829953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:11.830751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:11.831179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:11.861340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7dd85029-3cb8-4e75-8710-08ea1dc4ff66 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043766 Nov 19 20:07:11.861887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1898/3744] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:12.872724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:12.873635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:12.880212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:12.881214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:12.881964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:12.882441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:12.914311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fb0b4563-b921-4275-9c90-db6752ce8e3c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045251 Nov 19 20:07:12.914893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1847/3745] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:12 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:13.925803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:13.926859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:13.933630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:13.934148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:13.934875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:13.935301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:13.965784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-831180e0-d134-4c7e-959f-2dbbacddc564 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043702 Nov 19 20:07:13.966416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1899/3746] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:15.209262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:15.210690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:15.217837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:15.218383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:15.219210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:15.219683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:15.255380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ea8c7349-600e-49bd-8c76-79d47967710e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.279896 Nov 19 20:07:15.256212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1848/3747] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:16.269552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:16.270656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:16.278789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:16.279502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:16.281100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:16.281716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:16.318574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af1678c4-ad51-4580-93c8-e20e375a451e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052988 Nov 19 20:07:16.319172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1900/3748] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:17.329795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:17.330738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:17.337610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:17.338069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:17.338861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:17.339295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:17.370872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-269d94f4-037b-4f1e-9916-b5eb93b03398 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Nov 19 20:07:17.371449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1849/3749] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:18.385551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:18.386556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:18.395820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:18.396355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:18.397723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:18.398170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:18.427865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-65028126-6600-4fc3-ba3d-ef09f5e7518a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048196 Nov 19 20:07:18.428418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1901/3750] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:19.443018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:19.444001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:19.451452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:19.451919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:19.452721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:19.453111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:19.484390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-94842a8c-6d78-4544-90a7-0c7be035ce76 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047596 Nov 19 20:07:19.484951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1850/3751] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:20.496973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:20.497888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:20.504664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:20.505110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:20.505901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:20.506398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:20.538376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-facdb54f-6359-4a11-931a-efdaabf5ad71 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 Nov 19 20:07:20.538996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1902/3752] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:21.550682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:21.551614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:21.558813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:21.559264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:21.560044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:21.560532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:21.599031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4e228a02-2d43-467f-a4fd-9b6b6d42b1e7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052093 Nov 19 20:07:21.599602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1851/3753] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:22.615260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:22.616276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:22.625983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:22.626661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:22.627774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:22.628298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:22.659667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3463f512-597b-42c2-9250-f13b22a4c5ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050576 Nov 19 20:07:22.660234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1903/3754] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:23.671393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:23.672208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:23.679360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:23.679817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:23.680573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:23.681168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:23.720714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e0d449b1-f494-4438-91a9-4c6b552708a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053164 Nov 19 20:07:23.721304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1852/3755] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:24.732735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:24.733548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:24.740340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:24.740785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:24.742428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:24.742428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:24.773652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe63f820-ce81-4084-a9c8-e34951798568 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045212 Nov 19 20:07:24.774266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1904/3756] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:25.792908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:25.794087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:25.802633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:25.803231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:25.804697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:25.805347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:25.838815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ba090698-0ec8-4456-be16-6f5f977ac19f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055363 Nov 19 20:07:25.839404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1853/3757] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:26.851874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:26.853495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:26.862222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:26.862648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:26.863454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:26.863885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:26.895160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b6fe9bb0-a1e6-4e75-b9df-26d51e3247ce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047942 Nov 19 20:07:26.895725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1905/3758] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:27.907444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:27.908412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:27.915540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:27.916530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:27.917732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:27.917864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:27.949512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e0fadbc-ed6a-4418-9ad8-4c343aa71512 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045788 Nov 19 20:07:27.950236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1854/3759] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:28.961886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:28.962728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:28.969617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:28.970078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:28.970863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:28.971289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:29.001732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f3eeb395-7209-44d3-b6b4-5c7047e7e0b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Nov 19 20:07:29.002356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1906/3760] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:29.574171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:07:29.574465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:07:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:07:29.818867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:07:29.819462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:07:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:07:30.018379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:30.019375 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:30.026411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:30.027044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:30.027864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:30.028303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:30.061476 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-419d2f58-5cbd-44dc-8949-82aff89a1a37 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051439 Nov 19 20:07:30.062100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1855/3761] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:31.076235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:31.077330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:31.084374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:31.085189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:31.085981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:31.086473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:31.119694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-728cff1c-bf12-425f-936a-a62b2e4c6455 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049793 Nov 19 20:07:31.120269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1907/3762] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:32.131770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:32.132569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:32.139959 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:32.140407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:32.141181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:32.141611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:32.173749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f7869c40-95b1-4ef9-ab27-e84c8e19e6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Nov 19 20:07:32.174347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1856/3763] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:33.185685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:33.186616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:33.193390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:33.193839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:33.194634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:33.195062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:33.226729 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9bf83758-5962-4279-958b-3f89af69a187 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045372 Nov 19 20:07:33.227301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1908/3764] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:34.238870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:34.239780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:34.247009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:34.247517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:34.248998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:34.249925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:34.284202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fda02d66-d03e-41a1-aa73-e6b742e2ec75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049097 Nov 19 20:07:34.284769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1857/3765] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:35.297727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:35.298750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:35.308864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:35.309432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:35.310528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:35.311153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:35.344684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b55186d2-e4d0-4928-a266-59c0ac788e9b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051749 Nov 19 20:07:35.345478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1909/3766] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:36.360456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:36.361466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:36.371170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:36.371619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:36.372423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:36.372850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:36.408343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-28688d71-0652-4cf1-82d5-421f3d824acc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054131 Nov 19 20:07:36.408902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1858/3767] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:37.421812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:37.423020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:37.430987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:37.431447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:37.432537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:37.433067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:37.474983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-782d0b62-84a8-4edb-8ca7-abe9840becf9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057351 Nov 19 20:07:37.475667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1910/3768] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:38.495920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:38.496949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:38.504530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:38.504904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:38.505681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:38.506132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:38.535786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e35bb749-2a62-4521-b6a1-f89fe2614e31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050189 Nov 19 20:07:38.536345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1859/3769] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:39.549689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:39.550535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:39.557555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:39.557997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:39.558790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:39.559214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:39.591066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6fa28bf6-6283-4f3d-933f-353de64dcf96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Nov 19 20:07:39.591623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1911/3770] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:40.104796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:07:40.105010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:07:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:07:40.606901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:40.608294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:40.615277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:40.615724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:40.616502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:40.616928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:40.648577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7126dab5-f893-43f3-81b6-f805f4c3e123 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047700 Nov 19 20:07:40.649153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1860/3771] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:41.660473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:41.661388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:41.668276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:41.668717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:41.669497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:41.669923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:41.707084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8d6a5f9-d7f9-4a67-bbd4-3abf99c6848e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050454 Nov 19 20:07:41.707674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1912/3772] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:42.719590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:42.720484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:42.727319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:42.727774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:42.728555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:42.728986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:42.759722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-844c9f39-33c2-46c7-be85-ee19170a1dda tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Nov 19 20:07:42.760291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1861/3773] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:43.774825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:43.776233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:43.784070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:43.784549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:43.785382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:43.785744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:43.822894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c0c78981-1f63-4264-ad05-6289dd183ff9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053933 Nov 19 20:07:43.823456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1913/3774] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:43 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:44.838202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:44.839318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:44.848856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:44.849422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:44.850322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:44.850944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:44.883247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5b253c60-fa6d-4727-b226-e7c42d7162dc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050960 Nov 19 20:07:44.883805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1862/3775] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:45.897423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:45.898557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:45.906936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:45.907372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:45.908283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:45.908820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:45.939148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1e697908-0dda-4fb9-b6b0-6083a13583fc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047678 Nov 19 20:07:45.939715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1914/3776] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:46.513020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:46.513528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:46.519888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:46.520333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:46.521099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:46.521530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:46.535639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 could not be found. Nov 19 20:07:46.536115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 404 to user: Instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:07:46.536943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-126f99c1-fdf0-4e75-997e-eb6f72a31b7e tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 404 len: 111 microversion: 2.1 time: 0.027667 Nov 19 20:07:46.537481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1863/3777] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:07:46 2021] DELETE /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:07:46.545238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:46.545843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 048fc7ab-35b3-4b67-b7a4-05c90e948688] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:46.553350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:46.553795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:46.554608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:46.555047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:46.568976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 could not be found. Nov 19 20:07:46.569556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 404 to user: Instance 048fc7ab-35b3-4b67-b7a4-05c90e948688 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:07:46.570427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b83197b2-6998-4206-b665-befd8cc9a468 tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688" status: 404 len: 111 microversion: 2.1 time: 0.028815 Nov 19 20:07:46.570970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1915/3778] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:07:46 2021] GET /compute/v2.1/servers/048fc7ab-35b3-4b67-b7a4-05c90e948688 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:07:46.951499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:46.952451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:46.959284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:46.960073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:46.960877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:46.961307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:46.992575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dad19b35-4676-4677-97bd-c6c06de6d054 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045060 Nov 19 20:07:46.993126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1864/3779] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:48.007291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:48.008209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:48.015225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:48.015698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:48.016453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:48.016910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:48.054528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee0ece8c-3492-4510-ae48-4a1c3311a4b2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050930 Nov 19 20:07:48.055196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1916/3780] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:49.066701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:49.067515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:49.074421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:49.074862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:49.075636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:49.076062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:49.106445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc575505-ccef-4b97-aa8e-321f1552481f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043815 Nov 19 20:07:49.106997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1865/3781] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:50.118588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:50.119499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:50.125959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:50.126437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:50.127219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:50.127655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:50.159596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-83cde74c-f1e7-45c0-ab66-fe200b4304d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044846 Nov 19 20:07:50.160002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1917/3782] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:51.173561 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:51.174402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:51.181755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:51.182284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:51.183043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:51.183501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:51.217430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4852fe5a-50ae-4beb-bd4c-5d8c2d061108 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048173 Nov 19 20:07:51.218017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1866/3783] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:52.229428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:52.230286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:52.237407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:52.237850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:52.238811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:52.239241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:52.272092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1c122a82-74a3-433c-8e66-6ea1e0e174de tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046527 Nov 19 20:07:52.272658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1918/3784] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:53.284696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:53.285762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:53.292756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:53.293220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:53.294015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:53.294566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:53.327482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fe946948-631b-423e-81de-e9ffa54e8411 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046621 Nov 19 20:07:53.328044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1867/3785] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:54.340034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:54.340950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:54.347716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:54.348168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:54.349173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:54.349810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:54.381458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d61ae95c-c63d-4445-bf1e-8762e74a35f8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045097 Nov 19 20:07:54.382023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1919/3786] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:55.393312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:55.394154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:55.401160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:55.401662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:55.402479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:55.402910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:55.435717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-69165959-6bcf-4771-8a4b-938e5f7e2cf4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Nov 19 20:07:55.436310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1868/3787] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:56.448196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:56.449036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:56.455877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:56.456337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:56.457127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:56.457560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:56.491139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0662060f-0680-4803-a6d7-f10639b0f4cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Nov 19 20:07:56.491736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1920/3788] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:57.506267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:57.507754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:57.515218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:57.515695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:57.516506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:57.516936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:57.561900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0b6a3356-b33c-4a0b-9e17-c5a3f01072cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061832 Nov 19 20:07:57.563663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1869/3789] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:58.575548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:58.576351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:58.583083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:58.583507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:58.584647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:58.585172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:58.615920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5565d3dd-b48a-41c4-ad49-6eae9ce9cf70 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Nov 19 20:07:58.616473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1921/3790] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:07:59.627595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:07:59.628416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:07:59.635446 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:59.635900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:59.636690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:07:59.637125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:07:59.671149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-048a55b0-4d5d-4eb1-9693-5c0e82cce7b5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047424 Nov 19 20:07:59.671690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1870/3791] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:07:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:00.683769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:00.684573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:00.691559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:00.692004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:00.693048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:00.693323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:00.725281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6d08290-786a-491e-a417-3c31c9e2ab42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045366 Nov 19 20:08:00.725824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1922/3792] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:01.736818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:01.737774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:01.746013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:01.746477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:01.747292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:01.747727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:01.780048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c24d350a-dd50-4c81-8091-d5e605cc8ce1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046851 Nov 19 20:08:01.780557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1871/3793] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:02.793986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:02.794865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:02.801566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:02.802038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:02.802841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:02.803272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:02.836488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e277f563-4821-4ede-bf88-7854451d3779 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046298 Nov 19 20:08:02.837078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1923/3794] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:03.849207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:03.850019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:03.859451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:03.860265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:03.861153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:03.861590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:03.895195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b6851b30-0083-490a-b2fa-c72b4cc43c21 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049918 Nov 19 20:08:03.895756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1872/3795] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:04.911034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:04.911990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:04.921457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:04.922129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:04.923081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:04.923690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:04.963043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-effb89d0-2d5d-49ba-acbd-af915a955f14 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058221 Nov 19 20:08:04.963617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1924/3796] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:05.977466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:05.978454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:05.985250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:05.985697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:05.986516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:05.986948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:06.018489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9728a268-668b-4688-8ad3-25cf3a1cdeb5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046682 Nov 19 20:08:06.019048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1873/3797] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:07.031006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:07.031921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:07.038600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:07.039052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:07.039820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:07.040251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:07.071006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-24f4f595-58f7-4732-9553-753feb607438 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043767 Nov 19 20:08:07.071569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1925/3798] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:08.086018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:08.087015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:08.096101 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:08.096748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:08.097905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:08.098494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:08.130712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-693b2467-15b3-4e7f-8e00-c003fd3fb02b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050978 Nov 19 20:08:08.131276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1874/3799] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:09.142855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:09.144018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:09.151852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:09.152301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:09.153074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:09.153526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:09.187908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-15d190e4-b6f8-47a1-810d-d735943fb0f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048964 Nov 19 20:08:09.188483 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1926/3800] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:10.201437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:10.202289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:10.209700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:10.210188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:10.210981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:10.211420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:10.243006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b442509f-9bd4-4186-969b-a99396e67e1e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045746 Nov 19 20:08:10.243563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1875/3801] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:11.257427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:11.258403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:11.265543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:11.265992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:11.266794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:11.267226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:11.298187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-048ab2d6-f174-4196-9924-131fa1c38175 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Nov 19 20:08:11.298731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1927/3802] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:12.311863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:12.312769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:12.319502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:12.319940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:12.320713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:12.321148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:12.352763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-198bc77b-6b23-4969-b432-2bcd2646bf93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044874 Nov 19 20:08:12.353330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1876/3803] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:12 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:13.365371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:13.366316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:13.372873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:13.373313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:13.374068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:13.374538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:13.404550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-63061c87-e578-4086-93e7-084ed10f41b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042910 Nov 19 20:08:13.405109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1928/3804] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:14.426472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:14.427818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:14.436421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:14.436841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:14.437668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:14.438104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:14.471083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1152bd88-2339-478c-aed6-f75f7df610bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057280 Nov 19 20:08:14.471656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1877/3805] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:15.483741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:15.484578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:15.491447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:15.491887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:15.492674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:15.493087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:15.525398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79d972a3-4f5c-462a-833d-bec0c72c4ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Nov 19 20:08:15.525979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1929/3806] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:08:16.536787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:16.537703 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:16.544550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:16.544990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:16.545786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:16.546254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:16.579428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40a46628-29a2-4c7c-9acb-f9f1ad0b04cc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046587 Nov 19 20:08:16.580021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1878/3807] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:17.592759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:17.593693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:17.600858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:17.601306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:17.602137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:17.602573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:17.637608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e73d2878-5af1-47b6-81b0-98fdca5a3ac5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049667 Nov 19 20:08:17.638134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1930/3808] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:18.649854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:18.650820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:18.658194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:18.658637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:18.659409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:18.659849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:18.691089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6b15c8a5-e739-4632-bd61-9b1bab525a79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044918 Nov 19 20:08:18.691628 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1879/3809] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:19.702997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:19.703910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:19.710844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:19.711295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:19.712067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:19.712500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:19.742925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6fb8a656-13fa-4062-9e85-b18d758066d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043646 Nov 19 20:08:19.743529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1931/3810] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:20.755422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:20.756356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:20.763160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:20.763604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:20.764376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:20.764805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:20.795814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c459a874-8869-480b-a39a-9ae37ed75b82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044152 Nov 19 20:08:20.796417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1880/3811] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:21.808821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:21.809761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:21.816626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:21.817084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:21.817845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:21.818319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:21.863012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-69f4622a-5a02-4c94-9f1b-8d6cb9bc9b33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058064 Nov 19 20:08:21.863593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1932/3812] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:22.875678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:22.876595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:22.883495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:22.883944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:22.884730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:22.885157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:22.917344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ad21f55-f0e8-421e-b0ee-c5400c1a1f2c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045655 Nov 19 20:08:22.918331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1881/3813] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:23.929304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:23.930162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:23.938296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:23.938826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:23.939727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:23.940313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:23.973135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ee04d46-221d-47c7-81d2-64f4efcc45a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Nov 19 20:08:23.973695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1933/3814] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:24.986766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:24.987693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:24.994817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:24.995316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:24.996506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:24.996948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:25.029570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fdb80835-f565-4f2e-a197-42abbef211bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047827 Nov 19 20:08:25.030195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1882/3815] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:26.043606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:26.044557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:26.051435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:26.051879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:26.052661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:26.053150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:26.085962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5c681478-0d7d-44ec-a7e4-d5874ceee17a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047845 Nov 19 20:08:26.086568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1934/3816] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:27.097651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:27.098595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:27.105743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:27.106219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:27.106990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:27.107403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:27.141863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-375a866b-73d3-4476-8ad0-4cfcd41d67d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047769 Nov 19 20:08:27.142807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1883/3817] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:28.157727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:28.158404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:28.167956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:28.168695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:28.169981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:28.170743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:28.208204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79206256-c546-4750-a8ad-ffefcfa7e1a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054971 Nov 19 20:08:28.210291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1935/3818] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:29.221109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:29.222073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:29.228882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:29.229301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:29.230100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:29.230556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:29.263932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2dac453-cadc-4cc6-b6b7-9b25af184a85 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046468 Nov 19 20:08:29.264525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1884/3819] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:30.278929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:30.279834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:30.286651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:30.287098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:30.287860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:30.288287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:30.321552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-02d5d5c7-9606-4255-bce3-62aa6158d0d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048468 Nov 19 20:08:30.322130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1936/3820] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:31.333674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:31.334999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:31.342152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:31.342638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:31.343436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:31.343870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:31.381764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0614355c-0457-43b4-a365-7d6f6e5b15ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051888 Nov 19 20:08:31.382417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1885/3821] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:32.393181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:32.394159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:32.400994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:32.401440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:32.402276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:32.402711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:32.438229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-98069f2b-7967-42f8-b8f2-0a4b75c2f05a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048877 Nov 19 20:08:32.438814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1937/3822] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:33.451247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:33.452173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:33.459346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:33.459802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:33.460585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:33.461026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:33.492671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-440f9502-77fc-401e-a4ba-e2697fe312c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Nov 19 20:08:33.493245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1886/3823] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:34.504716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:34.505515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:34.512602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:34.513070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:34.513893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:34.514355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:34.544500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-82aa6e6c-6a42-495f-9f5a-e4acf09cf61d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043701 Nov 19 20:08:34.545038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1938/3824] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:35.556369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:35.557288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:35.564601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:35.565052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:35.565841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:35.566304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:35.598026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7acfb031-4a8e-45e6-bf9c-527dd7c5808c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045451 Nov 19 20:08:35.598647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1887/3825] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:36.611709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:36.612619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:36.619326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:36.619784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:36.620547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:36.620975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:36.653338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e03bb81c-6d28-40c2-9aea-9ee362f0aacf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Nov 19 20:08:36.656989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1939/3826] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:37.668383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:37.669439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:37.676083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:37.676551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:37.677330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:37.677754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:37.708275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-036ef8f5-a23e-4b8f-8adc-96ba847aafc1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Nov 19 20:08:37.708851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1888/3827] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:38.721026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:38.722225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:38.729947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:38.730424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:38.731209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:38.731831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:38.764994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4ace5502-0634-4d53-9b48-2777edc927e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048776 Nov 19 20:08:38.765568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1940/3828] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:39.777121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:39.778181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:39.785667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:39.786153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:39.786930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:39.787360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:39.817662 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-31a8da4a-9ac2-458f-8f0a-1a5c66ec8330 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044339 Nov 19 20:08:39.818273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1889/3829] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:40.830479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:40.831499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:40.839208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:40.839634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:40.840441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:40.840875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:40.880823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ba35f3cf-91f2-4a84-a000-d5b5d9f31829 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054397 Nov 19 20:08:40.881446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1941/3830] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:41.893481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:41.894456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:41.903739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:41.904228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:41.906177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:41.906705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:41.938750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c007e741-9c7a-4f62-82e1-f2f05db86730 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049331 Nov 19 20:08:41.939546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1890/3831] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:42.952006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:42.952916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:42.959965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:42.960409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:42.961186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:42.961619 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:42.995382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1bef509e-3c3b-40c7-af55-00405f7a5654 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047802 Nov 19 20:08:42.995970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1942/3832] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:44.007867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:44.008795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:44.015981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:44.016417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:44.017220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:44.017654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:44.049696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-005bc797-d72d-4ef9-a3ec-c16d020ceb39 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Nov 19 20:08:44.050366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1891/3833] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:45.061494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:45.062434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:45.069115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:45.069558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:45.070433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:45.070862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:45.103890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ebf2fae0-06e2-4a43-aa06-961a0e10f1df tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046744 Nov 19 20:08:45.104461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1943/3834] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:46.115465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:46.116276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:46.123179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:46.123797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:46.124722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:46.125183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:46.158475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66648661-0d15-4ecd-a9cb-855bbef2b4c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046827 Nov 19 20:08:46.159096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1892/3835] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:08:47.171822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:47.172753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:47.179563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:47.180016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:47.180806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:47.181243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:47.213844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-307ebade-ab80-4d59-aff1-44add8d656c3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046237 Nov 19 20:08:47.214478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1944/3836] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:48.226327 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:48.227178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:48.233918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:48.234402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:48.235192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:48.235631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:48.267686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-93e33c8b-1476-417a-8d10-c115e7d44008 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045821 Nov 19 20:08:48.268285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1893/3837] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:49.280681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:49.281603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:49.288409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:49.288855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:49.289629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:49.290080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:49.324195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-569339d9-de80-4e4a-8193-5f342a184b9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047420 Nov 19 20:08:49.324666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1945/3838] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:50.337065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:50.337976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:50.345007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:50.345470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:50.346286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:50.346726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:50.387804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9d967a18-d0d7-493f-92b1-eced42cbff29 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054827 Nov 19 20:08:50.388459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1894/3839] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:51.401736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:51.402850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:51.413509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:51.414325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:51.415556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:51.416283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:51.450060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a9719474-cbb9-477f-8ab4-31c58aee2b9f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053967 Nov 19 20:08:51.450694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1946/3840] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:52.463343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:52.464248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:52.472171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:52.472614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:52.473385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:52.473811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:52.504494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c3aa8f4d-da07-4970-b8fd-ec22acab1e8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045877 Nov 19 20:08:52.505043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1895/3841] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:53.172057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:08:53.172429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:08:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:08:53.518365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:53.519175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:53.525911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:53.526451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:53.527230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:53.527630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:53.558979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8d89b10-ea48-4959-b948-dbb2a46760dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Nov 19 20:08:53.559529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1947/3842] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:54.573653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:54.575067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:54.585992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:54.586622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:54.587809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:54.588519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:54.621329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-39dc4a29-ae7d-444c-abd1-2683daebdfbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053726 Nov 19 20:08:54.621943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1896/3843] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:55.637267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:55.638210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:55.645546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:55.645998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:55.646805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:55.647220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:55.678153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a328ff6-b9e7-4684-8d51-50fac69a88a9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Nov 19 20:08:55.678737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1948/3844] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:56.692529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:56.693432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:56.700291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:56.700740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:56.701504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:56.701957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:56.726775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:08:56.726969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:08:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments (ip 10.222.0.46) !!! Nov 19 20:08:56.748986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-38fd4705-8662-421c-937f-c7beab72627e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060237 Nov 19 20:08:56.750390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1897/3845] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:57.761948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:57.762876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:57.770897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:57.771454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:57.773890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:57.773890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:57.804424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8aa84d8e-26e7-4237-b67d-692204389e3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047471 Nov 19 20:08:57.804988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1949/3846] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:58.817823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:58.818788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:58.825750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:58.826260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:58.827077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:58.827515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:58.858862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7f9b7eca-a772-4908-a78c-9a36fb6b616e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Nov 19 20:08:58.859460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1898/3847] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:08:59.870888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:08:59.871803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:08:59.880164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:59.880843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:59.882197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:08:59.882638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:08:59.916324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c7ed6038-8cd7-4b60-926d-792cf9847de5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049214 Nov 19 20:08:59.916914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1950/3848] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:08:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:00.928884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:00.929829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:00.936709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:00.937156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:00.938414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:00.938871 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:00.971078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-822a36ff-fa7f-4b13-b433-c2955bd6bcca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045918 Nov 19 20:09:00.971655 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1899/3849] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:01.987258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:01.988162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:01.995012 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:01.995459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:01.996223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:01.996646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:02.026451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-042988de-9443-4532-af72-e9c35fe73a03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 Nov 19 20:09:02.026998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1951/3850] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:03.038467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:03.039390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:03.046930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:03.047388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:03.048167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:03.048603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:03.080153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5de8c9e0-81dd-4cce-96d0-c4a22759872d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045462 Nov 19 20:09:03.080727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1900/3851] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:04.092372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:04.093302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:04.101046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:04.101832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:04.102953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:04.103438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:04.139400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fbe47197-0cc9-49d3-ae8d-744d95cbb97d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050465 Nov 19 20:09:04.140088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1952/3852] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:05.152301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:05.153237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:05.160080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:05.160522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:05.161297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:05.161726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:05.201221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-32d72c52-a145-488d-ac43-2f20524138a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052688 Nov 19 20:09:05.201809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1901/3853] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:06.214080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:06.215048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:06.223249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:06.223709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:06.224460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:06.224887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:06.257931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7674d1d2-a7fc-4192-bc0d-400f95fa51a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048207 Nov 19 20:09:06.258519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1953/3854] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:07.270748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:07.271667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:07.278441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:07.278879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:07.279664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:07.280097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:07.311411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34ec93a0-6ded-42bd-82f3-e591d510fed3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044312 Nov 19 20:09:07.312031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1902/3855] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:08.325696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:08.326696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:08.335108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:08.335549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:08.336328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:08.336839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:08.370687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-596f952a-1ee0-4178-be70-0161a2bc6099 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049023 Nov 19 20:09:08.371259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1954/3856] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:09.383309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:09.384248 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:09.391599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:09.392054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:09.392822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:09.393246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:09.424709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56b4f683-b9f9-4965-94e1-68b808a0a95d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045273 Nov 19 20:09:09.425253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1903/3857] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:10.436688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:10.437647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:10.445114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:10.445556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:10.446342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:10.446793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:10.478431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bcd2485c-a44c-4dfb-88a9-a28ad3303f23 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Nov 19 20:09:10.479014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1955/3858] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:11.494544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:11.495656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:11.504136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:11.504581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:11.505368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:11.505852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:11.536659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66a6f62c-3c0a-4977-b7ce-a18d3bc3c48b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048056 Nov 19 20:09:11.537224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1904/3859] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:12.549307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:12.550171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:12.557148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:12.557602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:12.558415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:12.558855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:12.591411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0692c484-dfe4-4a12-8677-f8e344483fa8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046153 Nov 19 20:09:12.591970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1956/3860] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:12 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:13.603712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:13.604618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:13.611874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:13.612317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:13.613105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:13.613536 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:13.649142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4abba12e-0e67-4993-bc84-54a493d5b76c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049203 Nov 19 20:09:13.649756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1905/3861] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:14.662608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:14.663646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:14.670599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:14.671034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:14.671801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:14.672267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:14.717038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9962f712-0e8f-43f1-9ed6-1fa35db79c1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058948 Nov 19 20:09:14.717647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1957/3862] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:15.732166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:15.733113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:15.741210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:15.741659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:15.742462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:15.742895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:15.774468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8a58304-cd64-4aff-9dfc-d2fffc881881 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046578 Nov 19 20:09:15.775008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1906/3863] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:16.787317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:16.788289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:16.795215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:16.795672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:16.796458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:16.796891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:16.827621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d17cc0a-e10b-4e0a-90d7-d1b916402f79 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Nov 19 20:09:16.828184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1958/3864] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:17.840124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:17.841027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:17.847565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:17.848008 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:17.848776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:17.849210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:17.878974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-50cb5c81-8aa8-4082-b20c-4dbf13905e67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Nov 19 20:09:17.879524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1907/3865] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:18.891080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:18.891997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:18.898671 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:18.899115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:18.899882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:18.900305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:18.931575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17c0bd8a-40a0-4212-9293-d269434001e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044380 Nov 19 20:09:18.932160 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1959/3866] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:19.943150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:19.943965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:19.951497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:19.951930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:19.952715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:19.953142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:19.987153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e3b07e2c-1d23-4b62-a20f-82c7d42df600 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048281 Nov 19 20:09:19.988914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1908/3867] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:20.999962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:21.000973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:21.008919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:21.009423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:21.010335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:21.010812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:21.045757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-96090136-f7ab-4862-a649-01c425dd2c5a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049562 Nov 19 20:09:21.046368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1960/3868] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:22.060832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:22.062517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:22.075193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:22.075991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:22.077404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:22.078089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:22.121371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a251d2f-a667-4c4f-a3f5-59945b519f1d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067463 Nov 19 20:09:22.121954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1909/3869] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:23.133875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:23.134831 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:23.142032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:23.142515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:23.143455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:23.144196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:23.179169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ed6c61c-6ecb-4693-a2f0-dcb3c364c9e3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049499 Nov 19 20:09:23.179746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1961/3870] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:09:24.191726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:24.192753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:24.199939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:24.200390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:24.201182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:24.201617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:24.240741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-551220f5-5a48-4f43-9f9e-d2ef090a24cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053364 Nov 19 20:09:24.241502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1910/3871] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:24.457791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:09:24.458392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:09:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:09:25.253992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:25.254797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:25.263544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:25.263986 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:25.264951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:25.265520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:25.303500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4657dc6e-69b3-4cc8-bae3-b42a84ee0b49 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053819 Nov 19 20:09:25.304055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1962/3872] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:26.319565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:26.319565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:26.326075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:26.326895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:26.328287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:26.328737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:26.370420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5be7798d-c0b0-4566-9d69-c1fcf1558093 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058573 Nov 19 20:09:26.371018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1911/3873] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:27.384355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:27.385273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:27.393820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:27.394303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:27.395128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:27.395557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:27.429324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f46408eb-5d84-46b0-ae29-19455723e725 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049892 Nov 19 20:09:27.429908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1963/3874] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:28.443482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:28.444855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:28.453217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:28.453669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:28.455036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:28.455881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:28.492778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fbab4f79-5db5-4b1e-80af-1c915a38e82b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055017 Nov 19 20:09:28.493366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1912/3875] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:29.506834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:29.507670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:29.514509 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:29.514958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:29.515756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:29.516196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:29.547373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-619bf24e-3017-4ecb-8b7b-84bda55bbd67 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Nov 19 20:09:29.547950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1964/3876] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:09:30.558497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:30.559345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:30.566808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:30.567311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:30.568143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:30.568612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:30.601935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa6d205f-3fdf-49e4-b1ea-20d75f0bf61c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047351 Nov 19 20:09:30.602567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1913/3877] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:31.614275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:31.615139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:31.622454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:31.622910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:31.623701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:31.624130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:31.659828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cd03ccc4-b309-4c5c-9ae6-4a0d24fce37a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049564 Nov 19 20:09:31.660469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1965/3878] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:09:32.672254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:32.673083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:32.680137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:32.680589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:32.681378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:32.681817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:32.712770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8715d18c-24c0-4301-a3a1-6edddfa245f0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044395 Nov 19 20:09:32.713347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1914/3879] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:33.725639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:33.726498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:33.732974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:33.733428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:33.734325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:33.734730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:33.771361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e3023aa-e8ef-442b-8dd5-2d44c3d84d61 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050231 Nov 19 20:09:33.771959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1966/3880] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:34.784354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:34.785319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:34.797030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:34.797570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:34.798601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:34.799037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:34.835222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-63ed84bf-43ef-413d-90cb-f3634885c8b0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055301 Nov 19 20:09:34.835829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1915/3881] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:35.847813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:35.848730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:35.855559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:35.856002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:35.856781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:35.857207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:35.892850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-95da5457-662f-42a8-b4e6-3194f66126d9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049126 Nov 19 20:09:35.893405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1967/3882] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:36.906268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:36.907229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:36.917545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:36.918393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:36.919802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:36.920570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:36.956218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-446f88a4-6589-46ab-849a-67d599da36fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054791 Nov 19 20:09:36.956817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1916/3883] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:37.968541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:37.969463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:37.976240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:37.976815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:37.977610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:37.978029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:38.009585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04494477-7f37-47d1-956d-0e32fa338cb9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045029 Nov 19 20:09:38.010202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1968/3884] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:39.023766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:39.024752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:39.031948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:39.032402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:39.033205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:39.033642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:39.079286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3037e844-4c4c-4289-9791-ae3ebdab9909 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058991 Nov 19 20:09:39.079934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1917/3885] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:40.095865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:40.097467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:40.108435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:40.109078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:40.110339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:40.111080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:40.144108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-db1b308d-d8a4-4b30-9f96-aa42167487ff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054543 Nov 19 20:09:40.145055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1969/3886] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:41.156404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:41.157345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:41.164727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:41.165175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:41.165963 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:41.166517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:41.199724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85976adc-44b7-48d8-84a4-496dda483ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047130 Nov 19 20:09:41.200403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1918/3887] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:42.213143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:42.214320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:42.221815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:42.222422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:42.223326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:42.223713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:42.259508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f551be99-63ff-4b00-89f6-59aef2783cfd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051302 Nov 19 20:09:42.260168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1970/3888] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:43.272188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:43.273143 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:43.280787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:43.281239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:43.282068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:43.282582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:43.318667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-846faf1d-f82b-40e1-bcd4-dadcab83b1d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050985 Nov 19 20:09:43.319271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1919/3889] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:43 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:44.330648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:44.331546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:44.338579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:44.339020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:44.339792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:44.340219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:44.373848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b1d5705a-9b3c-4de4-a049-3309d5e71f62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046916 Nov 19 20:09:44.374466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1971/3890] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:45.386709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:45.387510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:45.394879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:45.395329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:45.396117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:45.396552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:45.430539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d4d1768a-eb16-43e8-8083-6e8221454ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Nov 19 20:09:45.431138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1920/3891] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:09:46.444841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:46.445902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:46.452737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:46.453185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:46.453963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:46.454431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:46.486794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-116f3557-8921-4d6c-8b2f-82bbf8977f5b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046194 Nov 19 20:09:46.488166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1972/3892] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:47.501005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:47.501938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:47.509495 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:47.509841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:47.510692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:47.511121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:47.545814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e9004571-f9b5-4367-8b49-760345f3af27 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048705 Nov 19 20:09:47.546455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1921/3893] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:48.558696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:48.559623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:48.569369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:48.570178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:48.571525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:48.572283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:48.607880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3ce61450-08d1-4e1c-ac4a-a9369b54ed03 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054040 Nov 19 20:09:48.608459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1973/3894] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:49.620365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:49.621533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:49.629351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:49.629850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:49.630681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:49.631112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:49.662299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d8081945-8ee9-436e-9974-37bbecda9d93 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046199 Nov 19 20:09:49.662860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1922/3895] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:50.674527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:50.675372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:50.681973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:50.682447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:50.683211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:50.683639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:50.714238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-520f16ec-f5a2-4dbf-9e14-8d7d26c4e1a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043748 Nov 19 20:09:50.714801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1974/3896] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:51.727716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:51.728548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:51.737864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:51.738527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:51.739727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:51.740333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:51.774726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c5d1d772-fed7-4d94-9313-e4411d9e26ba tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052282 Nov 19 20:09:51.775528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1923/3897] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:52.786557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:52.787472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:52.793982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:52.794585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:52.795361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:52.795794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:52.827560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bc942a2b-ed4c-4deb-a1d7-f8ceeb527ed6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044916 Nov 19 20:09:52.828108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1975/3898] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:53.840293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:53.841223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:53.847995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:53.848442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:53.849211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:53.849649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:53.878538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-891b6579-cc70-4388-af62-8403658c7902 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042062 Nov 19 20:09:53.879108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1924/3899] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:54.890368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:54.891285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:54.899195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:54.899651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:54.900424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:54.900853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:54.932913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb797d02-a5c3-4ce2-a6d9-2c4897699be1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Nov 19 20:09:54.933520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1976/3900] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:55.945455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:55.946406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:55.953286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:55.953731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:55.954543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:55.954965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:55.985740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7ba87d05-f2f7-46dc-bd93-851ca2d11e1a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Nov 19 20:09:55.986333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1925/3901] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:56.998330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:56.999240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:57.007263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:57.007728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:57.008502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:57.008928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:57.042103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-68b92a57-6e13-462c-a040-da9cdf0b5645 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047570 Nov 19 20:09:57.042684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1977/3902] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:58.053668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:58.054627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:58.061512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:58.061964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:58.062791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:58.063223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:58.094637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a6fdbec2-e8c3-4fd6-8add-252bbb7f88ee tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045423 Nov 19 20:09:58.095231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1926/3903] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:09:59.106603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:09:59.107560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:09:59.114692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:59.115241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:59.116038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:09:59.116463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:09:59.150316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-25a39e4a-ebc1-430f-ac56-aae83b6950a2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047456 Nov 19 20:09:59.150908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1978/3904] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:09:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:00.164261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:00.165179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:00.172913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:00.173538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:00.174777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:00.175332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:00.208807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f76b6eae-abf0-4d32-9e4b-b6590713f1a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049225 Nov 19 20:10:00.209678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1927/3905] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:01.220948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:01.221840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:01.228983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:01.229445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:01.230335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:01.230771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:01.265660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-51b6c6fe-b8e7-4752-83b9-2144f4747de1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048517 Nov 19 20:10:01.266287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1979/3906] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:02.277135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:02.278070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:02.285242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:02.285699 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:02.286513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:02.286950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:02.318108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-84039990-9a09-4510-a4e9-72480b018516 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Nov 19 20:10:02.319525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1928/3907] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:03.332508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:03.333952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:03.341263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:03.341701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:03.342502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:03.342926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:03.373769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-542ddfad-9623-4de0-acca-738967ca19a4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046736 Nov 19 20:10:03.374345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1980/3908] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:04.386661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:04.387571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:04.394348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:04.394800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:04.395691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:04.396132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:04.426434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f15116e3-0be7-41de-918b-e0e91fea7996 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043513 Nov 19 20:10:04.427021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1929/3909] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:05.439332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:05.440422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:05.449874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:05.450479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:05.451625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:05.452151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:05.484852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2b97949e-7845-4d9e-8ac6-d1d72c328c88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050759 Nov 19 20:10:05.485424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1981/3910] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:06.497029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:06.497993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:06.504915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:06.505453 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:06.506173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:06.506608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:06.537022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ad3e40f3-b7bc-44e7-8db0-6fd13c3fd33f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043845 Nov 19 20:10:06.537581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1930/3911] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:07.551550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:07.552515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:07.562574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:07.563178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:07.564365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:07.564987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:07.597406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8214ca5c-7e18-4c68-9cc1-292b50d399bb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051739 Nov 19 20:10:07.597966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1982/3912] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:08.609357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:08.610197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:08.617834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:08.618645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:08.619436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:08.619877 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:08.651387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c0d1b30c-9e62-4792-9e9e-159905f3e415 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 Nov 19 20:10:08.651965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1931/3913] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:09.663731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:09.664539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:09.671533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:09.671975 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:09.672753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:09.673178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:09.704302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-16ea7ac9-c6ef-4a89-9956-00ce255e0504 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Nov 19 20:10:09.704875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1983/3914] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:10.717474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:10.718324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:10.725138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:10.725584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:10.726403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:10.726835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:10.758809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e2d55426-1d55-4119-af72-6f8c22c940c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044909 Nov 19 20:10:10.759578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1932/3915] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:11.770897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:11.771896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:11.778983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:11.779435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:11.780211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:11.780643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:11.810680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa3f4fad-c6f3-4043-aa59-4e727559cf78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043549 Nov 19 20:10:11.811266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1984/3916] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:12.823776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:12.824710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:12.831799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:12.832250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:12.833043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:12.833848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:12.867370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be6662e8-7467-4db9-9978-bfab332c88a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047516 Nov 19 20:10:12.867994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1933/3917] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:12 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:13.882919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:13.883809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:13.893737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:13.894354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:13.895482 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:13.895918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:13.928022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-25e29fb1-742e-4815-8a03-9fe52125d0ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050904 Nov 19 20:10:13.928583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1985/3918] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:14.941035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:14.941881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:14.949463 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:14.949952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:14.950776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:14.951245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:14.985462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-927f2520-d0f2-4ffc-96fa-cfd095080429 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048275 Nov 19 20:10:14.986139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1934/3919] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:15.998110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:15.999363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:16.008337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:16.009249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:16.010966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:16.011941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:16.048203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-867d1264-5512-434b-9484-cb9199dae5b7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054230 Nov 19 20:10:16.048793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1986/3920] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:17.060556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:17.061462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:17.068013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:17.068458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:17.069233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:17.069667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:17.099930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0d114f8-160f-4d15-b0a2-8637dd2038dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043159 Nov 19 20:10:17.100497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1935/3921] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:18.112393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:18.113350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:18.120792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:18.121275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:18.122033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:18.122504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:18.156109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae3331c8-a6d2-4d16-9c4a-10a90c517186 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047518 Nov 19 20:10:18.156710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1987/3922] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:19.170566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:19.171576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:19.180553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:19.181134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:19.182261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:19.182659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:19.214603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5acb5d91-bf48-4b66-8c3d-6230fb5aa212 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049653 Nov 19 20:10:19.215186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1936/3923] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:20.226675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:20.227733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:20.235425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:20.235870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:20.236690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:20.237097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:20.270504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d1139b5c-5376-428f-8728-b5fdf3fa1609 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047961 Nov 19 20:10:20.271445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1988/3924] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:21.281894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:21.282850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:21.289892 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:21.290365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:21.291149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:21.291580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:21.324211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ed89ba4-fcbf-4c44-ab28-62395fcc3def tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Nov 19 20:10:21.324807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1937/3925] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:22.340435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:22.341354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:22.348709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:22.349131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:22.349945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:22.350389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:22.385769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-103f5f43-db6d-4a71-b874-1a85fbbf4a42 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050117 Nov 19 20:10:22.386680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1989/3926] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:23.398584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:23.399482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:23.407062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:23.407510 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:23.408287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:23.408717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:23.441669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3a9a3a4e-a5ab-4fea-b839-36faefc2df77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046954 Nov 19 20:10:23.442319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1938/3927] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:24.454079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:24.455099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:24.462346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:24.462798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:24.463587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:24.464016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:24.500257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-49a31ef5-3747-4fc0-a237-8d21a2f6c433 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050390 Nov 19 20:10:24.500846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1990/3928] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:25.512377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:25.513624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:25.520216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:25.520634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:25.521414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:25.521851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:25.552301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60ecb4b9-2d52-46c1-b43f-2b70081f5f1c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043936 Nov 19 20:10:25.552893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1939/3929] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:26.568380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:26.569696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:26.579658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:26.580258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:26.581341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:26.582002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:26.615844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-12b23fb3-6117-4bed-b2f7-57d078d70755 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053745 Nov 19 20:10:26.616402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1991/3930] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:27.631069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:27.632124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:27.640036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:27.640482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:27.641261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:27.641666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:27.673258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bc021360-fc31-4649-b806-efb1b2df321a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048088 Nov 19 20:10:27.673809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1940/3931] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:28.687203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:28.688025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:28.694879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:28.695306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:28.696114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:28.696554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:28.733942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-57d0dc5b-f707-4c81-be70-40d41b8499cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050836 Nov 19 20:10:28.735008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1992/3932] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:29.746544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:29.747554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:29.757200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:29.757660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:29.758486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:29.758922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:29.791925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5ff51f75-0998-40a8-b47c-63284ba37f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049197 Nov 19 20:10:29.792494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1941/3933] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:30.805522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:30.806464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:30.813402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:30.813849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:30.814660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:30.815092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:30.845704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1e4d37a-cadd-4a2b-9266-df80c67d4e33 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Nov 19 20:10:30.846290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1993/3934] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:31.859338 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:31.860870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:31.867835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:31.868284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:31.869066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:31.869493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:31.901335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3460d36c-fa9b-4aed-936b-31f090af93bd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Nov 19 20:10:31.901891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1942/3935] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:32.913759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:32.914727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:32.921956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:32.922466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:32.923331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:32.923901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:32.954752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb15c765-bd17-4f78-b2bc-5589f4f0898b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Nov 19 20:10:32.955453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1994/3936] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:33.968674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:33.969638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:33.978102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:33.978102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:33.978687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:33.979154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:34.013083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-680337a0-e373-472a-ad9b-c6310ef5465b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048427 Nov 19 20:10:34.013678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1943/3937] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:35.025016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:35.025937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:35.032821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:35.033549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:35.034359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:35.034818 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:35.068271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-437a6ee8-4470-44aa-9744-46805416107a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047008 Nov 19 20:10:35.068835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1995/3938] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:36.081085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:36.081996 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:36.089212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:36.089660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:36.090477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:36.090913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:36.121836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3796ce0-d9a5-4432-8705-4f21ec20a009 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Nov 19 20:10:36.122444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1944/3939] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:37.133884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:37.134723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:37.141702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:37.142203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:37.143101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:37.143510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:37.173989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4c6f8479-fd04-4a21-a4a5-01397b6f953f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043868 Nov 19 20:10:37.174782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1996/3940] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:38.186459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:38.187237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:38.194469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:38.194913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:38.195685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:38.196111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:38.228612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5ed5ebdf-eac0-4e09-83ce-4f4972212c62 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046122 Nov 19 20:10:38.229243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1945/3941] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:39.240754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:39.241657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:39.248718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:39.249161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:39.249915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:39.250388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:39.281589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8fb9792-2c33-4ece-a947-4e8747cc6f24 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Nov 19 20:10:39.282168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1997/3942] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:40.293130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:40.294079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:40.301444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:40.301901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:40.302747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:40.303184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:40.336572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e1393a1-b400-4d22-8686-fae5b923ccdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047217 Nov 19 20:10:40.337144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1946/3943] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:41.349244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:41.350055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:41.356903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:41.357353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:41.358167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:41.358609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:41.389020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-12fbc694-28db-41a9-b1b9-8eccd2d659b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043870 Nov 19 20:10:41.389576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1998/3944] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:42.400983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:42.401804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:42.408901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:42.409355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:42.410180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:42.410616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:42.441712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-12bc7e2a-d2e4-4dff-8256-2b46e1918229 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Nov 19 20:10:42.442307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1947/3945] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:43.456343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:43.457603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:43.468404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:43.468977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:43.470238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:43.470836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:43.502974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3024aa4b-752c-441c-a594-3338dc43816a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052533 Nov 19 20:10:43.503523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 1999/3946] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:43 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:44.519277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:44.520244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:44.528922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:44.529447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:44.530371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:44.530867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:44.565991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ff5539de-3ff0-40f0-966c-a43e15532f77 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051365 Nov 19 20:10:44.566879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1948/3947] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:45.579600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:45.580682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:45.588226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:45.588674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:45.589448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:45.589886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:45.620745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-822d8e28-0856-4a67-a0ed-38421e2d469d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Nov 19 20:10:45.621291 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2000/3948] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:46.635347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:46.636360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:46.645287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:46.645916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:46.647067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:46.647638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:46.683874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a773d4f0-0ef4-4cfd-be02-6ced082799e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054426 Nov 19 20:10:46.684440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1949/3949] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:47.696100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:47.697020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:47.704520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:47.705080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:47.705848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:47.706542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:47.739064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b0a2387d-0f24-450e-ae9e-dc7226018826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046656 Nov 19 20:10:47.739612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2001/3950] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:48.752807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:48.753855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:48.761159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:48.761615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:48.762472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:48.762917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:48.795653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c39d828f-b1bb-43bd-b2c4-927ab32e909e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046656 Nov 19 20:10:48.796239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1950/3951] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:49.593417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:10:49.594077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:10:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:10:49.807644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:49.808560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:49.815254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:49.815797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:49.816666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:49.817138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:49.837640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:10:49.838252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:10:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:10:49.849993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a38bd91e-2a3f-4104-9c1e-f5a234a42c02 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046386 Nov 19 20:10:49.850685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2002/3952] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:50.862366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:50.863207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:50.870140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:50.870600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:50.871362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:50.871783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:50.902849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bda64861-c301-49e0-a5be-9d5215e6016c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Nov 19 20:10:50.903397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1951/3953] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:51.915041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:51.915875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:51.922623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:51.923064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:51.923839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:51.924259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:51.954799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6f2c0a17-86d8-401e-8d11-c0665a8b6c8d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043623 Nov 19 20:10:51.955359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2003/3954] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:52.967199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:52.968017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:52.975411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:52.975923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:52.976729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:52.977133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:53.009736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f59aa2ae-78fd-4c7e-b6a3-8f8dbda2f6e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046396 Nov 19 20:10:53.010356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1952/3955] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:54.021794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:54.022862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:54.030003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:54.030513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:54.031279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:54.031735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:54.064174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ffe615ac-ee8a-44ac-93bb-111b79a2d7ec tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046198 Nov 19 20:10:54.064747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2004/3956] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:55.076616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:55.077533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:55.084933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:55.085384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:55.086212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:55.086648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:55.118954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5695579d-aeb7-41d2-a20e-68d7366f3ebb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Nov 19 20:10:55.119542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1953/3957] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:56.130407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:56.131338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:56.138441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:56.138918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:56.139693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:56.140128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:56.179771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4abfc606-2bcc-46ea-b04a-8e26e0bf78d4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053333 Nov 19 20:10:56.180329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2005/3958] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:57.191414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:57.192837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:57.199608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:57.200051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:57.200839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:57.201267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:57.238947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-29995475-1c6b-4f73-8177-2b2f2596b1ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051070 Nov 19 20:10:57.239471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1954/3959] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:58.251690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:58.252805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:58.261563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:58.262002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:58.262815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:58.263236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:58.295100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7ef6c536-d169-4925-a140-50f136e0f916 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047542 Nov 19 20:10:58.295507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2006/3960] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:10:59.307470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:10:59.308410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:10:59.315650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:59.316098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:59.316901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:10:59.317311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:10:59.348000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-deb73f41-c85c-46b8-9cf0-6407eb71eaf7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044626 Nov 19 20:10:59.348573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1955/3961] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:10:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:00.123596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:11:00.124159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:11:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:11:00.360561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:00.361786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:00.369334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:00.369783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:00.370612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:00.371040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:00.402479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ed373849-3f5c-4273-bf71-aa8da8929d4b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045868 Nov 19 20:11:00.402937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2007/3962] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:01.415028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:01.415941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:01.422882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:01.423333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:01.424106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:01.424539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:01.457543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f6b71959-8db7-46d5-99f7-8bf168439742 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Nov 19 20:11:01.458137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1956/3963] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:02.470403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:02.471371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:02.480136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:02.480571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:02.481354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:02.481796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:02.525724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5fb3f6a-6e43-4b05-a68b-ea3216974fc3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058851 Nov 19 20:11:02.526236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2008/3964] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:03.537048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:03.537864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:03.545550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:03.545994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:03.546856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:03.547288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:03.579936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-251f9c5c-a67c-4020-b1b8-62ac5f61ad7f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046735 Nov 19 20:11:03.580529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1957/3965] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:04.592435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:04.593259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:04.600003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:04.600601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:04.602036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:04.602494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:04.633575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ae94c4bf-09bf-4258-89c1-67b75b88d41f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045001 Nov 19 20:11:04.634166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2009/3966] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:05.645492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:05.646461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:05.653650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:05.654138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:05.655114 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:05.655367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:05.688429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8d4299d9-2161-40bb-9f09-1758296f4373 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046788 Nov 19 20:11:05.689020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1958/3967] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:06.700591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:06.701411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:06.708170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:06.708620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:06.709756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:06.710246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:06.747843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bf325df6-6486-469a-93b1-ca725afb0c3b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051104 Nov 19 20:11:06.748440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2010/3968] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:07.758812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:07.759747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:07.766592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:07.767033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:07.767815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:07.768243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:07.801133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-566eff32-fab8-40fa-9d46-77188c7a4423 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Nov 19 20:11:07.801694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1959/3969] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:08.820512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:08.822701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:08.838233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:08.838984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:08.840347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:08.841115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:08.878322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-94abaccf-1106-401b-91c0-6d562d5608a5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068084 Nov 19 20:11:08.878936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2011/3970] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:09.890645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:09.891554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:09.898368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:09.898822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:09.899604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:09.900034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:09.930929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b144078-f221-41f6-af85-50af8a7d7cd1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044045 Nov 19 20:11:09.931654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1960/3971] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:10.942910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:10.943746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:10.951129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:10.951580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:10.952377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:10.952808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:10.988066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3b4060e9-2d48-48f0-a7b5-f0c5ca8b145f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048953 Nov 19 20:11:10.988680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2012/3972] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:12.001130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:12.002160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:12.009849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:12.010337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:12.011130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:12.011570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:12.050438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8f4e8698-e469-4742-bef7-8ae2ef8c9cca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053007 Nov 19 20:11:12.051316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1961/3973] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:13.063219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:13.065209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:13.072680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:13.073132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:13.073912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:13.074380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:13.106960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7b2bfd9-ab5a-4d5f-892e-0e6dda62498f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Nov 19 20:11:13.107544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2013/3974] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:14.119060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:14.120018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:14.127132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:14.127568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:14.128370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:14.128803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:14.164835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1848aee2-c318-4f26-9c96-eba14015804d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049552 Nov 19 20:11:14.165449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1962/3975] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:15.176931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:15.177854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:15.185341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:15.185860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:15.186772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:15.187208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:15.223798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3fa532c1-b192-45a3-be50-ee17a981cb95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050721 Nov 19 20:11:15.224384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2014/3976] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:16.236243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:16.237187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:16.245323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:16.245845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:16.246829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:16.247305 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:16.284614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dec85611-1ae0-4ea0-a9af-dfd15c813b75 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052192 Nov 19 20:11:16.285169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1963/3977] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:17.297149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:17.298264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:17.307015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:17.307531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:17.308396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:17.308883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:17.346320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7ecb40f-1b83-44d7-8323-654e08e78ce8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053188 Nov 19 20:11:17.346890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2015/3978] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:18.359518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:18.360482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:18.367479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:18.367954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:18.368758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:18.369192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:18.403140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d0cd644-05ac-4468-a404-97bd09f2164d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048679 Nov 19 20:11:18.403733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1964/3979] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:19.414976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:19.415950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:19.422738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:19.423186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:19.423973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:19.424408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:19.458141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-29d9d313-f1d2-4121-bde4-0f991e9f7482 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047368 Nov 19 20:11:19.461678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2016/3980] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:11:20.470748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:20.471667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:20.479207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:20.479704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:20.480516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:20.480929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:20.514987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-79cb2aa5-787a-46c1-91d9-0017e6d30c4a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047982 Nov 19 20:11:20.515464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1965/3981] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:21.527773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:21.528822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:21.536300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:21.536738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:21.537540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:21.537995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:21.574872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-370670c6-6ff5-4012-99a0-7ac19295ab96 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050585 Nov 19 20:11:21.575876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2017/3982] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:22.588322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:22.589211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:22.596590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:22.597159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:22.598214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:22.598740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:22.633043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8fff4d9a-6de6-4ffc-bc38-90c82fe854b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049299 Nov 19 20:11:22.633675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1966/3983] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:23.644976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:23.645935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:23.653286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:23.653739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:23.654579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:23.655015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:23.689184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ddaac93f-d9ab-462d-a710-b9aed0561ad2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047946 Nov 19 20:11:23.689773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2018/3984] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:24.701493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:24.702360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:24.710601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:24.711049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:24.711865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:24.712296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:24.745619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c219922-114c-4a4e-a396-36a4a62ff66d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048190 Nov 19 20:11:24.746253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1967/3985] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:11:25.758517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:25.759468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:25.766398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:25.766860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:25.767626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:25.768062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:25.800023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-338a22b3-42d5-4548-a75c-c697f6ff1faf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045518 Nov 19 20:11:25.800601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2019/3986] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:26.813302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:26.814253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:26.821030 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:26.821663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:26.822568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:26.823050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:26.859627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b5540ce5-f621-4297-954b-7bf2526cb799 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050174 Nov 19 20:11:26.860202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1968/3987] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:27.876207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:27.877057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:27.883931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:27.884383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:27.885153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:27.885573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:27.924432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-61259039-32da-407e-9444-a745e57ab142 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054370 Nov 19 20:11:27.925395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2020/3988] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:28.937767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:28.939404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:28.945789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:28.946275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:28.947082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:28.947520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:28.983102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f48c46ae-9cc3-4945-8ecd-bdd2dac0b9e2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050218 Nov 19 20:11:28.983694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1969/3989] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:29.996672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:29.997595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:30.004251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:30.004679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:30.005446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:30.005876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:30.044569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a6e993af-ad2c-4dac-a397-10cda1b5d4d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051648 Nov 19 20:11:30.045128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2021/3990] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:31.056900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:31.057979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:31.065028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:31.065478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:31.066314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:31.066753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:31.099527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-80a465b6-d9a9-42c2-8d3b-ef0ba3648715 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046596 Nov 19 20:11:31.100120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1970/3991] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:32.111807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:32.112720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:32.119639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:32.120083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:32.120843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:32.121281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:32.153748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72b26108-9416-454a-ab0c-3a83112fc48c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045686 Nov 19 20:11:32.154365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2022/3992] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:33.165848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:33.166837 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:33.173869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:33.174341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:33.175155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:33.175587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:33.209739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-33ef25d3-bfb0-46f2-b4ea-9507806228ac tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047363 Nov 19 20:11:33.210935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1971/3993] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:34.221469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:34.222602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:34.232263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:34.232999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:34.234303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:34.234902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:34.269673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-84e323fd-e6a0-47fc-9461-b9ecbd1e0743 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052346 Nov 19 20:11:34.270292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2023/3994] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:35.283001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:35.284303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:35.293702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:35.294318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:35.295204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:35.295816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:35.328346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8699dc7-8947-4acb-b23d-af6d7bcea43d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049791 Nov 19 20:11:35.328933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1972/3995] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:36.340981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:36.341894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:36.348953 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:36.349386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:36.350248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:36.350702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:36.384939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0f0d3563-644f-431c-b7da-a8f5da1e8cb0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047688 Nov 19 20:11:36.385543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2024/3996] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:37.398340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:37.399496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:37.408957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:37.408957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:37.408957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:37.408957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:37.456744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0a942220-8af7-4773-b5ae-db45b5f1ca0c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062093 Nov 19 20:11:37.457554 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1973/3997] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:38.470299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:38.471083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:38.478276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:38.478720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:38.479517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:38.479936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:38.512201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bcfe43a9-7ed7-4130-bf33-f88822be9875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Nov 19 20:11:38.512773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2025/3998] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:39.524325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:39.525835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:39.532750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:39.533185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:39.533995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:39.534460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:39.567983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74dc0f0a-5591-43a9-8231-2bf0abe97d10 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047543 Nov 19 20:11:39.568544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1974/3999] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:40.583568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:40.585746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:40.597724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:40.598470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:40.599621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:40.600308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:40.631841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb1b3bc0-0754-4369-9eff-85e5397bf1d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054452 Nov 19 20:11:40.632427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2026/4000] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:41.644897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:41.645821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:41.653269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:41.653720 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:41.654549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:41.654980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:41.687827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-207420c2-2ea0-494d-ac34-dc10325b382d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Nov 19 20:11:41.688409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1975/4001] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:42.700827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:42.701644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:42.708259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:42.708702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:42.709910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:42.710288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:42.747846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-57596b4c-f435-4253-82be-476c0aaddcfb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051748 Nov 19 20:11:42.748421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2027/4002] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:43.760238 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:43.761155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:43.767958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:43.768407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:43.769182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:43.769657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:43.801782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-87c51714-982d-4f6d-b1bd-dfc1d8b8f361 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045329 Nov 19 20:11:43.802310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1976/4003] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:43 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:44.813502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:44.814386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:44.822271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:44.822826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:44.823623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:44.824060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:44.856408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-27bf5c54-e53f-4e1f-8070-48b1fdca5cd3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046811 Nov 19 20:11:44.856968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2028/4004] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:45.868712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:45.869664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:45.877961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:45.878479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:45.879268 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:45.879694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:45.912253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-43377bf3-9097-4a32-be03-f3a434b4fda1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047705 Nov 19 20:11:45.912841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1977/4005] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:46.923895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:46.924768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:46.931373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:46.931920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:46.932693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:46.933130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:46.964356 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8f7249f4-9c0b-4dee-8818-9b81320228d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044360 Nov 19 20:11:46.964919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2029/4006] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:47.979309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:47.980127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:47.986988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:47.987432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:47.988232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:47.988623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:48.020969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d14f507-6f61-442b-8819-aee24a01eb1b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047651 Nov 19 20:11:48.021543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1978/4007] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:49.033290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:49.034218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:49.040903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:49.041943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:49.042598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:49.043034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:49.074066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67e2c15d-9c25-40f8-ace7-7b0e50cf9e72 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Nov 19 20:11:49.074658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2030/4008] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:50.087543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:50.088502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:50.095512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:50.095957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:50.096731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:50.097159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:50.128178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0247bcee-5b97-4165-8d90-29fed4a821e0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Nov 19 20:11:50.128744 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1979/4009] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:51.140465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:51.141372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:51.148441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:51.148888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:51.149663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:51.150132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:51.181491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-926bb047-eda1-4a4b-b5b0-5b0ba36f78ca tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044890 Nov 19 20:11:51.182093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2031/4010] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:52.196117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:52.197149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:52.203664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:52.204109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:52.204876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:52.205302 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:52.236363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e60e4996-e470-4f08-85d0-bb456ba31e9e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Nov 19 20:11:52.236922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1980/4011] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:53.248093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:53.249015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:53.256852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:53.257309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:53.258116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:53.258551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:53.288991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-64033c83-cbf5-4b6e-9d74-24df7f41b56d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Nov 19 20:11:53.289648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2032/4012] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:54.304240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:54.305319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:54.313309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:54.313755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:54.314577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:54.315007 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:54.348041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8a6bb475-e51d-41b1-a6ea-c5314c3cc4c2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049719 Nov 19 20:11:54.348611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1981/4013] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:55.360364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:55.361269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:55.367984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:55.368436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:55.369211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:55.369642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:55.400730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ff9d38a-cd18-4e87-8ab9-4b7ca72fca00 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044163 Nov 19 20:11:55.401308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2033/4014] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:56.412712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:56.413658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:56.420946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:56.421413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:56.422210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:56.422642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:56.456932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8df4ed9-e734-4601-ac0f-4ebc2687f104 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 Nov 19 20:11:56.457195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1982/4015] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:57.471985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:57.473008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:57.485631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:57.486069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:57.486852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:57.487277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:57.519629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8d9152d-49cc-4e90-a26e-4a19357e7bcc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053982 Nov 19 20:11:57.520175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2034/4016] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:58.531605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:58.532515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:58.539459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:58.539903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:58.540670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:58.541103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:58.572075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66c7b3d8-0ee0-466f-96ab-537ffac6cf2d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044523 Nov 19 20:11:58.572623 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1983/4017] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:11:59.587399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:11:59.588484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:11:59.596199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:59.596652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:59.597435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:11:59.597864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:11:59.627794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3b768d71-7c85-426c-9dbc-e13e0fe20d22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046888 Nov 19 20:11:59.628343 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2035/4018] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:11:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:00.639997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:00.640790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:00.647588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:00.648042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:00.648822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:00.649258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:00.679564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9b568296-0c0f-4f53-8ac7-e31ab604fe5e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043557 Nov 19 20:12:00.680126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1984/4019] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:01.694437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:01.695644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:01.705735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:01.706460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:01.707669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:01.708285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:01.745518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7fbcd227-eb5b-4d79-88be-cd889a58d98a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056812 Nov 19 20:12:01.746574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2036/4020] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:02.760151 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:02.761241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:02.769372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:02.769867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:02.770819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:02.771249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:02.803195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ee5c81f8-fa19-4099-8741-43a8036f410e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Nov 19 20:12:02.803762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1985/4021] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:03.815424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:03.816232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:03.823432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:03.823872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:03.824653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:03.825125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:03.867558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-47455c3f-7b85-4501-83b8-a05d0cc35cf3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054976 Nov 19 20:12:03.869169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2037/4022] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:04.882393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:04.883203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:04.889965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:04.890443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:04.891215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:04.891614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:04.923646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1790760a-3f1e-4064-b900-562b10d77875 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045664 Nov 19 20:12:04.924224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1986/4023] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:05.939586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:05.941126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:05.953240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:05.954071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:05.955403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:05.956188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:05.991898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e11b3892-80f0-415f-ab45-900cfcaa1f9a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059485 Nov 19 20:12:05.992478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2038/4024] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:07.004366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:07.005283 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:07.012355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:07.012809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:07.013606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:07.014071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:07.047280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-19bf7986-9168-423d-a01f-5c2a36856382 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046624 Nov 19 20:12:07.047847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1987/4025] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:08.063495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:08.064782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:08.073275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:08.073690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:08.074535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:08.074943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:08.106261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c016dc06-ff0e-4bab-9f06-e5af54dcc605 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Nov 19 20:12:08.106836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2039/4026] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:09.118516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:09.119459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:09.126500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:09.126948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:09.127726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:09.128140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:09.159318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-951e0b08-ef8c-429d-bcdb-2a6b8bd62e56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Nov 19 20:12:09.159900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1988/4027] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:10.172603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:10.173507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:10.180427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:10.180877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:10.181638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:10.182088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:10.218332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3ba873ee-c59a-4997-9cfb-47e661c90f4e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050414 Nov 19 20:12:10.218995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2040/4028] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:11.231928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:11.233178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:11.240912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:11.241497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:11.242362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:11.242836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:11.280147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02e1cdc7-e511-45b2-bc02-e5e84578cb60 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052721 Nov 19 20:12:11.280893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1989/4029] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:12.293099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:12.294074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:12.301040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:12.301511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:12.302416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:12.302867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:12.333344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-824a5dcd-7f30-48ed-a52b-ceadb93663c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044052 Nov 19 20:12:12.333910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2041/4030] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:12 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:13.192267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:12:13.192923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:12:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:12:13.346812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:13.347987 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:13.359648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:13.360336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:13.361315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:13.361741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:13.393141 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b546502-6381-4713-8c75-964ad058d6a0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051901 Nov 19 20:12:13.393707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1990/4031] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:14.407428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:14.408369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:14.415133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:14.415584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:14.416350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:14.416776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:14.447380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5241d2e8-a879-45a8-b0d9-16a5b1f99312 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Nov 19 20:12:14.447934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2042/4032] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:15.545569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:15.546778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:15.553627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:15.554071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:15.554864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:15.555291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:15.588483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cf60e827-5b7e-4653-9e91-69712a166b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132201 Nov 19 20:12:15.589325 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1991/4033] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:16.600719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:16.601620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:16.608422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:16.608864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:16.609615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:16.610072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:16.641111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8b64fbf2-148d-4838-b33c-5586f5aa67f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044164 Nov 19 20:12:16.641650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2043/4034] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:16.758653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:12:16.759200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:12:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:12:17.653418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:17.654348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:17.661418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:17.661941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:17.662894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:17.663420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:17.694508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c22b035e-01e9-4031-b992-45c362764df7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045024 Nov 19 20:12:17.695065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1992/4035] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:18.706158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:18.706979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:18.713765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:18.714262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:18.715005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:18.715427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:18.745485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aef48492-5d48-4fcd-84bf-22f13676de28 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043263 Nov 19 20:12:18.746037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2044/4036] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:19.759642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:19.760901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:19.769364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:19.769812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:19.770664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:19.771096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:19.801016 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8bb99105-7a9a-4475-96fe-d5c6b88b27cf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047221 Nov 19 20:12:19.801579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1993/4037] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:20.812888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:20.814601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:20.821546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:20.821992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:20.822796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:20.823227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:20.855331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e98b78d4-ceeb-4b20-9697-6c43e32ec721 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046165 Nov 19 20:12:20.855871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2045/4038] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:21.868508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:21.869481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:21.880367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:21.880816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:21.881622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:21.882067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:21.913775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be6dd867-fa1f-4d6c-be5f-089f637654f2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049977 Nov 19 20:12:21.914543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1994/4039] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:22.927333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:22.928236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:22.935450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:22.935895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:22.936688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:22.937116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:22.968882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fe6ff808-22e1-449d-8760-31110186e79c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045299 Nov 19 20:12:22.969505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2046/4040] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:23.983673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:23.984637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:23.993611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:23.994085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:23.994915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:23.995346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:24.027131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-52b9014f-8668-4087-a536-fa15529b540c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049255 Nov 19 20:12:24.027688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1995/4041] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:25.041111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:25.042130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:25.050799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:25.051227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:25.052018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:25.052449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:25.083378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e53c40b8-732c-43da-9980-812aef2b7522 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047652 Nov 19 20:12:25.084199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2047/4042] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:26.095821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:26.096729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:26.103455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:26.103904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:26.104678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:26.105111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:26.135717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b8f56a9b-f6aa-4565-b8d7-3b2569158a56 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Nov 19 20:12:26.136281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1996/4043] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:12:27.149106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:27.149995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:27.157036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:27.157520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:27.158321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:27.158750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:27.192171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b3e00284-28a9-4cf1-8ee0-8e2f5b0187f6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046840 Nov 19 20:12:27.192754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2048/4044] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:28.207613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:28.208562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:28.217758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:28.218424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:28.220109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:28.220579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:28.250851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-528dd79f-bc1a-4912-88a1-04c4afaf9819 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048234 Nov 19 20:12:28.252017 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1997/4045] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:29.264056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:29.264991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:29.271883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:29.272327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:29.273145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:29.274138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:29.307140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0651434-d0cf-403c-8d47-c935c1f0d74f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Nov 19 20:12:29.308009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2049/4046] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:30.319637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:30.320443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:30.327383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:30.327824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:30.328668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:30.329106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:30.362960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-63441312-6560-4847-88c0-d94493062220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047256 Nov 19 20:12:30.363530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1998/4047] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:31.375271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:31.376217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:31.382932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:31.383378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:31.384116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:31.384543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:31.414767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ac7d931-8451-48ee-b053-4213c2bb3f16 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Nov 19 20:12:31.415332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2050/4048] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:32.427356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:32.428271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:32.435624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:32.436071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:32.436856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:32.437291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:32.471692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ffe36dce-a832-4a90-b6b6-3ca8d5238807 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047992 Nov 19 20:12:32.472418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 1999/4049] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:33.485473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:33.486406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:33.494643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:33.495126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:33.496208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:33.496723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:33.527566 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d76d8f1-344b-464a-ae6b-55ce57026ef9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Nov 19 20:12:33.528044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2051/4050] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:34.539540 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:34.540346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:34.547051 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:34.547499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:34.548351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:34.548765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:34.578734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ac99123-5649-4bad-90ec-80ebab1bfa31 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043117 Nov 19 20:12:34.579499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2000/4051] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:35.591100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:35.592001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:35.599053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:35.599494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:35.600265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:35.600692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:35.630600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a41d89d-e7ec-438f-adb4-78318c39d947 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043249 Nov 19 20:12:35.631153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2052/4052] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:36.644875 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:36.646394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:36.655702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:36.656247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:36.657342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:36.657918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:36.689181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1cb4b57e-3ef6-4902-94d9-02c83dc8dcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049744 Nov 19 20:12:36.689728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2001/4053] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:37.703326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:37.704454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:37.712304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:37.712842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:37.713514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:37.713944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:37.744574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6a8ab22c-9b6f-4f8d-9f32-924c6a73910a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047290 Nov 19 20:12:37.745136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2053/4054] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:38.757182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:38.758125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:38.765099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:38.765549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:38.766378 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:38.766808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:38.798579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-10fbef99-9e08-44db-a8f2-0b79a33aba4c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045838 Nov 19 20:12:38.799131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2002/4055] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:39.812949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:39.814200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:39.823093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:39.823678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:39.824706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:39.825295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:39.858065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a397a0cd-59f0-4654-8acb-0cb299d73596 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050273 Nov 19 20:12:39.858660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2054/4056] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:40.872113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:40.873029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:40.879957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:40.880407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:40.881177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:40.881609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:40.914643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7ec908f5-18b4-4b68-b265-90110361409c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046315 Nov 19 20:12:40.915213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2003/4057] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:41.926380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:41.927196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:41.934034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:41.934515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:41.935285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:41.935715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:41.967887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d963367c-6aaa-4bfd-99fc-b12f64e37c47 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Nov 19 20:12:41.968436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2055/4058] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:42.979931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:42.980754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:42.987443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:42.987919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:42.989018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:42.989517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:43.021693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b71c2c82-a7e2-47d7-b0b4-d5f3f2aa63e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Nov 19 20:12:43.022361 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2004/4059] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:44.033637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:44.034588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:44.041935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:44.042417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:44.043190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:44.043623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:44.074475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9e7ced29-a291-4065-8e63-e700a3580ae8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Nov 19 20:12:44.075050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2056/4060] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:12:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:12:44.486216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:12:44.486522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:12:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:12:45.088117 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:12:45.088940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:45.095915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:45.096451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:45.097163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:45.097601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:45.178966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-830fab93-6964-41e8-9ab9-1dd9d64c97bc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action" status: 200 len: 41585 microversion: 2.1 time: 0.094904 Nov 19 20:12:45.179627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2005/4061] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 20:12:45 2021] POST /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/action => generated 41585 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 19 20:12:46.771835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:46.772384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:46.779264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:46.779710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:46.780565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:46.781088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:46.811290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Going to try to terminate instance {{(pid=116111) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 20:12:46.893655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-161012f7-23ff-48b4-b8d7-72778206f6fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 204 len: 0 microversion: 2.1 time: 0.125695 Nov 19 20:12:46.894587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2057/4062] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:12:46 2021] DELETE /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 20:12:46.905577 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:46.906318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:46.913562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:46.914020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:46.914830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:46.915269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:47.130265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:47.143782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aeb7f1a5-ab11-43ff-b4e1-f1195ca2a33b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.243279 Nov 19 20:12:47.144518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2006/4063] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:46 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:48.165388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:48.166064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:48.175398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:48.175997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:48.176902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:48.177330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:48.389688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:48.398515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-76e26005-8a0d-450a-84c9-96552739805e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.238956 Nov 19 20:12:48.399086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2058/4064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:48 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:49.415484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:49.416100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:49.424636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:49.425084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:49.425868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:49.427178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:49.575790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:49.579793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-466ff903-6d24-4679-ba57-c72e863c31d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167750 Nov 19 20:12:49.580440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2007/4065] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:49 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:50.598896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:50.599703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:50.606082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:50.606545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:50.607312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:50.607738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:50.760849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:50.771971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3ff291fc-a49f-431a-8b0e-164ae8d34991 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176251 Nov 19 20:12:50.783397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2059/4066] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:50 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:51.790746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:51.791358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:51.798159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:51.798652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:51.799487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:51.799901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:52.083834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:52.100126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1bd5afe-70f2-4e27-9d8f-e3cbd43ae1ab tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.313005 Nov 19 20:12:52.101099 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2008/4067] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:51 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:53.120752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:53.121387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:53.130657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:53.131097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:53.131863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:53.132297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:53.539646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:53.552805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ce14ef72-0ed4-4fab-9e00-f38626d089f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.437560 Nov 19 20:12:53.553633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2060/4068] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:53 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:54.577652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:54.578542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:54.587068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:54.587516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:54.588290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:54.588717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:54.731174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:54.739753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd70c090-8ec4-4809-9f3c-a6de51da4163 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167128 Nov 19 20:12:54.740380 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2009/4069] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:54 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:55.757717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:55.758363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:55.764951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:55.765495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:55.766184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:55.766632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:55.913620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:55.922475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b71ad44f-a39c-4bfa-b43a-79a032bb1441 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168543 Nov 19 20:12:55.923040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2061/4070] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:55 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:56.943357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:56.944098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:56.950800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:56.951245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:56.952023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:56.952448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:57.093500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:57.101745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-979b20df-0c67-4fdc-86cb-375c02ddf98f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163094 Nov 19 20:12:57.102354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2010/4071] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:56 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:58.118327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:58.118919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:58.124966 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:58.125420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:58.126212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:58.126644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:58.265827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:58.275884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1bffd47e-d8ee-4b71-b1a1-581734c993ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.161553 Nov 19 20:12:58.276431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2062/4072] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:58 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:12:59.301565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:12:59.302603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:12:59.313282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:59.313974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:59.315234 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:12:59.315919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:12:59.468868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:12:59.479342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46441c93-7489-403b-bad3-6f7233d4a115 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.183664 Nov 19 20:12:59.479927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2011/4073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:12:59 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:00.496644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:00.497256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:00.503998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:00.504446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:00.505201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:00.505759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:00.643344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:00.652706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d98c85b-1515-4b9d-a007-7aa945197e12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.159702 Nov 19 20:13:00.653284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2063/4074] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:00 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:01.672607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:01.673252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:01.681614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:01.682085 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:01.682922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:01.683348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:01.832612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:01.845793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7d3270a-ea75-4cba-b3f3-d7f9b4ab2aa1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178940 Nov 19 20:13:01.846687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2012/4075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:01 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:02.866083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:02.866723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:02.873210 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:02.873649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:02.874492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:02.874864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:03.023560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:03.031996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c958aaf1-7987-402f-ad93-21366bffb5a8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171514 Nov 19 20:13:03.032554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2064/4076] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:02 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:04.051616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:04.052249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:04.059093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:04.059543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:04.060320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:04.060750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:04.202472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:04.211885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e85eee2-c2fd-4506-9f87-1a6d11ddf199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163977 Nov 19 20:13:04.212456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2013/4077] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:04 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:05.233243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:05.233821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:05.240906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:05.241308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:05.242134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:05.242554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:05.394890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:05.403073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a0ba9e19-71c9-4d3f-9e29-606a0774fa85 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173624 Nov 19 20:13:05.403695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2065/4078] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:05 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:06.421013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:06.421630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:06.428116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:06.428571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:06.429441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:06.429884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:06.588376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:06.596386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9b1e347d-a2f7-4214-b907-816f6dba6858 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179166 Nov 19 20:13:06.597166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2014/4079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:06 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:07.613788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:07.614403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:07.622038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:07.622548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:07.623304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:07.623752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:07.766743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:07.775285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d5fe8e6-bbcd-4ff4-a804-09ca1b2a61a1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165086 Nov 19 20:13:07.782288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2066/4080] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:07 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:08.793092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:08.793718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:08.800883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:08.801330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:08.802148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:08.802572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:08.981094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:08.990211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-abbbfcca-bd79-41a6-9941-97e4ad18e815 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.201329 Nov 19 20:13:08.990790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2015/4081] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:08 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:10.007528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:10.008795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:10.015334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:10.015766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:10.016574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:10.016998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:10.162817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:10.171618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-088d0cbd-cb96-49b9-883a-310e270573fc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167832 Nov 19 20:13:10.172200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2067/4082] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:10 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:11.189029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:11.189627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:11.197371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:11.197817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:11.198660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:11.199094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:11.339897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:11.348738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2b78ad9-6eba-4237-9290-dbc09d69cc67 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163378 Nov 19 20:13:11.349313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2016/4083] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:11 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:12.366522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:12.367148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:12.374112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:12.374587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:12.375368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:12.375794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:12.515880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:12.524826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d15e7ccd-27b7-459f-9c49-794999305700 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162249 Nov 19 20:13:12.525398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2068/4084] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:12 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:13.542836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:13.543217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:13.549925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:13.550423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:13.551274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:13.551711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:13.689764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:13.698543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f71c987-6c01-4869-ab6f-af4090ce0435 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160020 Nov 19 20:13:13.699110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2017/4085] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:13 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:14.717522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:14.718157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:14.724969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:14.725414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:14.726572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:14.727007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:14.871834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:14.880520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6fa5f015-88af-4ac4-bbd7-9ebede58989b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166717 Nov 19 20:13:14.881039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2069/4086] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:15.897381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:15.898298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:15.904852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:15.905298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:15.906077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:15.906524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:16.047269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:16.056064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0e9569e3-00eb-456e-9b59-110002701cf9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162255 Nov 19 20:13:16.056722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2018/4087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:15 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:17.075224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:17.075971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:17.082459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:17.082901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:17.083670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:17.084092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:17.229474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:17.237488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-81ed94ef-fa11-47c4-b5e3-ff6151b13b1e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166580 Nov 19 20:13:17.238248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2070/4088] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:17 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:18.254820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:18.254820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:18.261156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:18.261676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:18.262504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:18.262921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:18.402100 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:18.410354 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df272070-ec34-4880-a26a-4af98fc87029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160077 Nov 19 20:13:18.410960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2019/4089] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:18 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:19.428252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:19.428824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:19.435679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:19.436153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:19.436928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:19.437354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:19.581954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:19.595515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-72d446cb-4fbc-4dcd-9a3f-6b592be324f0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170799 Nov 19 20:13:19.596385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2071/4090] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:20.614838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:20.615412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:20.623590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:20.624222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:20.625355 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:20.626081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:20.772504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:20.780823 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4d03cf1c-ebb6-455d-abc4-b80ee27a7588 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170970 Nov 19 20:13:20.781420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2020/4091] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:20 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:21.800726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:21.801314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:21.810627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:21.811126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:21.812207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:21.812743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:21.951530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:21.960267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7efb2ff4-a55d-4b62-bde9-41b14b06bb61 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165139 Nov 19 20:13:21.961208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2072/4092] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:22.980535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:22.981189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:22.991121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:22.991792 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:22.992980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:22.993549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:23.133894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:23.143033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-74563cd9-218d-42e4-9d09-d69a2994c139 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168479 Nov 19 20:13:23.143624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2021/4093] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:22 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:24.160401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:24.160977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:24.168499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:24.168945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:24.169721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:24.170174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:24.320063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:24.328863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4f46ab81-4096-4bb2-a207-105c0bdedd5f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172092 Nov 19 20:13:24.329461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2073/4094] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:24 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:25.348311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:25.348988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:25.356036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:25.356515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:25.357498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:25.358071 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:25.517328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:25.526374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c9d0d660-2db9-49b8-b405-4141acd2eb99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.182438 Nov 19 20:13:25.526909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2022/4095] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:25 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:26.543999 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:26.544617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:26.551516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:26.551988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:26.552770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:26.553207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:26.707332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:26.722017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-44082ba9-fdfc-466e-8cc7-59ecb41860ac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181760 Nov 19 20:13:26.727188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2074/4096] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:26 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:27.739537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:27.740133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:27.746828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:27.747849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:27.748254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:27.748595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:27.906277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:27.917690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6dbefed4-e1a5-4943-b82c-80283b259f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181693 Nov 19 20:13:27.918504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2023/4097] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:28.936427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:28.937202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:28.943526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:28.943927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:28.944697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:28.945123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:29.108870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:29.123856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-49a474d0-a05a-47db-a66b-573fda0572d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.192106 Nov 19 20:13:29.124869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2075/4098] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:28 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:30.143721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:30.144343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:30.150872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:30.151530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:30.152320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:30.152750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:30.298264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:30.309060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cbf5051e-d824-4246-a4d3-f653a3a06b4c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168971 Nov 19 20:13:30.309644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2024/4099] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:30 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:31.326559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:31.327138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:31.334385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:31.334900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:31.336110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:31.336604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:31.475957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:31.484656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fdf83628-a120-426b-8e8a-7b20c374b3b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.161842 Nov 19 20:13:31.485251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2076/4100] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:31 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:32.502926 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:32.503624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:32.513601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:32.514080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:32.515193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:32.515845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:32.664364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:32.672749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bdf7e981-cbcb-45b4-bb18-ab5e9bbdb048 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.174075 Nov 19 20:13:32.673340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2025/4101] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:32 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:33.690389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:33.691042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:33.697555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:33.697997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:33.698764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:33.699201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:33.848971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:33.864880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-58a6daab-c04a-40e7-ab8d-d6ff430c1401 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177857 Nov 19 20:13:33.866349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2077/4102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:33 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:34.887916 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:34.888786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:34.897920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:34.898389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:34.899202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:34.899625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:35.045812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:35.054372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11686506-9d84-46cc-9d5d-7e087997098d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173014 Nov 19 20:13:35.054935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2026/4103] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:34 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:36.071295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:36.071901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:36.081772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:36.082245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:36.083027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:36.083452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:36.413695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:36.429526 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c2f9aafa-25bb-435c-b41f-72cb078c9da9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.361405 Nov 19 20:13:36.430484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2078/4104] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:36 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:37.451989 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:37.452585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:37.459731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:37.460176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:37.461308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:37.461737 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:37.606011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:37.614673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3cea5f08-c419-4b3a-8120-d08bf2c5d886 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166189 Nov 19 20:13:37.615318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2027/4105] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:37 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:38.633027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:38.633622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:38.641396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:38.642181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:38.643473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:38.644161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:38.817592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:38.826899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5615ba51-388c-416c-900c-3a6839cf713b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.197613 Nov 19 20:13:38.827484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2079/4106] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:38 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:39.845704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:39.846790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:39.853980 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:39.854518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:39.855432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:39.856084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:40.002701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:40.011219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1bde2f77-1469-4147-a5a2-7df145125b2d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169092 Nov 19 20:13:40.011804 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2028/4107] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:39 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:41.029772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:41.030506 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:41.037599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:41.038067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:41.038865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:41.039297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:41.187172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:41.195663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-524f7bea-35ed-4f8b-a305-8ad7d6ea9be6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170403 Nov 19 20:13:41.196324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2080/4108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:41 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:42.220853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:42.221451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:42.228278 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:42.228726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:42.229498 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:42.229935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:42.374156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:42.383023 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2849fb94-25c1-4ca5-879d-251154705d77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165825 Nov 19 20:13:42.383601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2029/4109] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:42 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:43.401156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:43.401780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:43.408686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:43.409135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:43.409914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:43.410384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:43.553328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:43.562193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6bf48996-b236-4bfc-af6b-ab172353bb71 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164859 Nov 19 20:13:43.562804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2081/4110] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:43 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:44.580214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:44.580991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:44.588730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:44.589240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:44.590195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:44.590689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:44.746670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:44.756716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ddb745b-a901-428c-9d6b-baaf79201722 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.180247 Nov 19 20:13:44.757493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2030/4111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:44 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:45.774384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:45.774992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:45.785389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:45.785834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:45.786748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:45.787181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:45.951173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:45.959607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2752ea04-bfc6-40b4-a5cd-bcfdbdf0c11f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188852 Nov 19 20:13:45.960149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2082/4112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:45 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:46.963301 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:46.963886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:46.970340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:46.970786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:46.971555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:46.971970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:46.977151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:46.977858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:46.984916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:46.985361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:46.986187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:46.986607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:46.986731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d could not be found. Nov 19 20:13:46.987377 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 404 to user: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:13:46.988209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f47e1070-449a-446c-911c-98b38f066bed tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 404 len: 111 microversion: 2.1 time: 0.029425 Nov 19 20:13:46.988851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2031/4113] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:13:46 2021] DELETE /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:13:46.996932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:46.997543 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] [instance: 35ef8da0-cc9a-484a-b675-ce4bbc67b34d] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:47.003898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:47.004424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:47.005206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:47.005630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:47.019172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] HTTP exception thrown: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d could not be found. Nov 19 20:13:47.019753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] Returning 404 to user: Instance 35ef8da0-cc9a-484a-b675-ce4bbc67b34d could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:13:47.020572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-39392413-41d0-4a6d-ba1c-c15f8da8a3de tempest-AttachVolumeShelveTestJSON-1040495451 tempest-AttachVolumeShelveTestJSON-1040495451-project] 10.222.0.46 "GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d" status: 404 len: 111 microversion: 2.1 time: 0.027702 Nov 19 20:13:47.021111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2032/4114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:46 2021] GET /compute/v2.1/servers/35ef8da0-cc9a-484a-b675-ce4bbc67b34d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 19 20:13:47.127713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:47.136040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-98d19155-2fc5-4247-ac0d-973fef917b57 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162525 Nov 19 20:13:47.136798 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2083/4115] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:46 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:48.156264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:48.156970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:48.163407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:48.163881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:48.164644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:48.165078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:48.315936 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:48.324901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f0731cbb-1df6-472e-b8dd-004d2dc3a6cc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173455 Nov 19 20:13:48.325481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2033/4116] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:48 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:49.342401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:49.342889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:49.349386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:49.350444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:49.350600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:49.351043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:49.497252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:49.506030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-62b85a90-9bae-45aa-98ba-6eb89ae4bdea tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167677 Nov 19 20:13:49.506618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2084/4117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:49 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:50.528855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:50.529910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:50.541281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:50.541721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:50.542773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:50.543501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:50.709087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:50.717953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bde82f75-5d7c-4c4b-9960-53a98e2d53b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.196838 Nov 19 20:13:50.718619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2034/4118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:50 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:13:51.735808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:51.736839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:51.744313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:51.744913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:51.746105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:51.747073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:51.795530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef83ac4a-4bf8-4df8-b72d-e0ecfb45e8b7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Action: 'create', calling method: .version_select at 0x7fc14ca09b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1611854875"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:13:51.891918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:51.899896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-029d07ff-289a-4c62-b4df-b8a0827251bc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167979 Nov 19 20:13:51.900471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2035/4119] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:51 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:52.093617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef83ac4a-4bf8-4df8-b72d-e0ecfb45e8b7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.440033 Nov 19 20:13:52.101351 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2085/4120] 10.222.0.46 () {60 vars in 1154 bytes} [Fri Nov 19 20:13:51 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 19 20:13:52.106558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b74a2020-66eb-4192-b59c-40c1dd9ee1ed tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1485b4280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:52.210465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b74a2020-66eb-4192-b59c-40c1dd9ee1ed tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.108701 Nov 19 20:13:52.211423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2036/4121] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:13:52.918111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:52.918706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:52.926076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:52.926552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:52.927304 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:52.927731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:53.074887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:53.083452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9408485-6c57-42fa-a9ba-3d7883673db8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169508 Nov 19 20:13:53.084018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2086/4122] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:52 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:53.223710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-33140e2d-9cbb-4fcc-b374-3113204b9a06 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada9d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:53.273785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-33140e2d-9cbb-4fcc-b374-3113204b9a06 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054151 Nov 19 20:13:53.274477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2037/4123] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:53 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:13:54.102568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:54.103162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:54.111199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:54.111643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:54.112498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:54.113072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:54.272348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:54.280707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8bfe45c-23aa-4679-8bb3-ccb69fa20627 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.182443 Nov 19 20:13:54.281763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2087/4124] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:54 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:54.287520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-324f12a4-2f42-45d4-8c1b-01215f7a3eee tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:54.346199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-324f12a4-2f42-45d4-8c1b-01215f7a3eee tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.063310 Nov 19 20:13:54.346797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2038/4125] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:54 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:13:55.303054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:55.304179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:55.315655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:55.316215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:55.317610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:55.318069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:55.361104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a0c61165-ef57-4175-82ca-c3e1fc4231fd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1485b4f70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:55.423767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a0c61165-ef57-4175-82ca-c3e1fc4231fd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.067496 Nov 19 20:13:55.428381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2039/4126] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:55 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:13:55.490377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:55.498727 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-75a68b36-a9ee-498f-bb3e-a411bd43fc47 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.202471 Nov 19 20:13:55.499314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2088/4127] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:55 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:56.436209 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04d2d243-35c7-4041-ac79-53418018f1d2 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849fee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:56.488320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04d2d243-35c7-4041-ac79-53418018f1d2 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056297 Nov 19 20:13:56.489053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2040/4128] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:56 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:13:56.515973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:56.516757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:56.523297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:56.523827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:56.524567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:56.524925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:56.662001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:56.674073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b11b110d-3b85-4112-85bd-a84856c50f89 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162140 Nov 19 20:13:56.674822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2089/4129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:56 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:57.504784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c2fb17f-b7ef-4885-932e-27c6addd6c50 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:57.553189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c2fb17f-b7ef-4885-932e-27c6addd6c50 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054910 Nov 19 20:13:57.553860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2041/4130] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:57 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:13:57.692635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:57.693204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:57.700271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:57.700723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:57.701501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:57.702643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:57.852062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:57.860735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d751960f-6d40-471f-be3b-20f94acc5824 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171872 Nov 19 20:13:57.861284 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2090/4131] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:57 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:58.569880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-98ff04ec-5990-40d7-9acb-813adc6508af tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cadaa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:58.620215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-98ff04ec-5990-40d7-9acb-813adc6508af tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056691 Nov 19 20:13:58.620790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2042/4132] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:58 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:13:58.884823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:58.885614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:13:58.893638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:58.894073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:58.894903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:13:58.895298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:13:59.035318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:13:59.048257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-beae92a5-2fcd-4f43-9e5e-464fd7f63747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168013 Nov 19 20:13:59.049156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2091/4133] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:13:58 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:13:59.634218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f43f3aa0-8143-4bf6-b5eb-8fc7b84cfaf0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:13:59.680617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f43f3aa0-8143-4bf6-b5eb-8fc7b84cfaf0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050468 Nov 19 20:13:59.681169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2043/4134] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:13:59 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:00.071093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:00.071657 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:00.078789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:00.079234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:00.080003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:00.080438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:00.226093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:00.236316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3edc83f2-7f44-4ef9-abae-1fac7325ca21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168994 Nov 19 20:14:00.236916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2092/4135] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:00 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:00.696326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e74f921-a004-4295-b441-e554a93f1138 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40e50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:00.749245 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e74f921-a004-4295-b441-e554a93f1138 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059218 Nov 19 20:14:00.749820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2044/4136] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:00 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:01.255940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:01.256687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:01.263955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:01.264480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:01.265339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:01.265897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:01.413086 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:01.427768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-70463edc-0377-42f5-b280-2f8fe08b02e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.175772 Nov 19 20:14:01.428752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2093/4137] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:01 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:01.762427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2d2a64c2-10f3-4081-85cf-591bf3f33b48 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:01.818856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2d2a64c2-10f3-4081-85cf-591bf3f33b48 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060456 Nov 19 20:14:01.819603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2045/4138] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:01 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:02.453615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:02.454658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:02.461765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:02.462247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:02.463003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:02.463428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:02.606733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:02.615310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9b475ab0-d1de-4443-a0b0-dcd830d5884b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167287 Nov 19 20:14:02.615855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2094/4139] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:02 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:02.832171 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b52bc0f-e8ee-42da-a39c-d350722993a8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cadadc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:02.881513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b52bc0f-e8ee-42da-a39c-d350722993a8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054012 Nov 19 20:14:02.882083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2046/4140] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:02 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:03.633645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:03.634235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:03.640937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:03.641388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:03.642520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:03.642951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:03.791454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:03.801613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2b170529-d4a4-4f13-b8de-e3a58b4cc121 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171903 Nov 19 20:14:03.802201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2095/4141] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:03 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:03.895387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-66ba53ec-a056-46b2-a5c0-b99f98bc4de0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14831c3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:03.942488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-66ba53ec-a056-46b2-a5c0-b99f98bc4de0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051332 Nov 19 20:14:03.943055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2047/4142] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:03 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:04.819223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:04.819943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:04.826379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:04.826833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:04.827614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:04.828050 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:04.955730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-30cb3acf-0e99-48f1-9738-d760f73f01e5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada4c0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:04.989647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:04.997636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-241dcc3c-19db-4aac-9a27-ba1d02588518 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.182017 Nov 19 20:14:04.998205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2096/4143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:04 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:05.004410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-30cb3acf-0e99-48f1-9738-d760f73f01e5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052866 Nov 19 20:14:05.005029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2048/4144] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:04 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:06.016940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:06.018612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:06.018693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8ee1f9ec-59b3-4a6e-b921-b3c8cb1b21a0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:06.024402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:06.024943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:06.025718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:06.026183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:06.065213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8ee1f9ec-59b3-4a6e-b921-b3c8cb1b21a0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051526 Nov 19 20:14:06.065773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2049/4145] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:06 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:06.161937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:06.170295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-309945f9-03c5-42e3-8de3-d8b265a17c98 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.157089 Nov 19 20:14:06.170868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2097/4146] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:06 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:07.078356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1d78d01-b743-4c52-a5fc-aa9d8a9d2db7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb591f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:07.129226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1d78d01-b743-4c52-a5fc-aa9d8a9d2db7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054949 Nov 19 20:14:07.129795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2050/4147] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:07 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:07.187592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:07.188198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:07.195156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:07.195615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:07.196398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:07.196864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:07.345940 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:07.354576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e4a5ae4a-95fb-4276-a378-1001956eee8a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170555 Nov 19 20:14:07.355184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2098/4148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:07 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:08.142225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4744d0d4-2eca-4a99-a828-50e7e84ec848 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832fa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:08.190636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4744d0d4-2eca-4a99-a828-50e7e84ec848 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052163 Nov 19 20:14:08.195922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2051/4149] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:08 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:08.374903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:08.375840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:08.386244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:08.386936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:08.388038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:08.388626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:08.546949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:08.556350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-73e3def9-0989-4e28-a35a-3c983c9688f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.186973 Nov 19 20:14:08.556894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2099/4150] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:08 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:09.203952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c2445600-4ef0-40db-b4af-f6a161a507b1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:09.254674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c2445600-4ef0-40db-b4af-f6a161a507b1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054518 Nov 19 20:14:09.254974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2052/4151] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:09 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:09.578826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:09.579412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:09.586605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:09.587095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:09.587981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:09.588604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:09.614358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:14:09.614593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:14:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 (ip 10.222.0.46) !!! Nov 19 20:14:09.764823 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:09.772941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a10e992f-5706-4c98-ad0a-66607e9deb6d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.197862 Nov 19 20:14:09.773492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2100/4152] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:09 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:10.267169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2a550cbc-9414-4fdf-9b98-b0ac36852b0c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:10.321769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2a550cbc-9414-4fdf-9b98-b0ac36852b0c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059005 Nov 19 20:14:10.322363 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2053/4153] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:10 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:10.790414 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:10.791154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:10.797807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:10.798275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:10.799039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:10.799463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:10.933015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:10.941734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-426318a6-b8cc-493b-9e92-b7691398c3f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.155046 Nov 19 20:14:10.942364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2101/4154] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:10 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:11.335534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ce02e3f-c6c5-48da-80ec-8f95f1466a63 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb420d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:11.386455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ce02e3f-c6c5-48da-80ec-8f95f1466a63 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055188 Nov 19 20:14:11.387057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2054/4155] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:11 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:11.959576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:11.960192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:11.967205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:11.967675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:11.968443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:11.968873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:12.108403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:12.117897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-987856f6-7d56-4a9b-9f29-a48ec767fd26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.161765 Nov 19 20:14:12.118107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2102/4156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:11 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:12.399897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-980d0f18-9b6c-4862-a548-d8d7a76d9ebb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:12.452529 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-980d0f18-9b6c-4862-a548-d8d7a76d9ebb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055733 Nov 19 20:14:12.453018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2055/4157] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:12 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:13.134962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:13.135588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:13.142230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:13.142675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:13.143426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:13.143924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:13.286833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:13.295027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-336bfd9f-d984-482e-b799-a45ac544faaa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163805 Nov 19 20:14:13.295623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2103/4158] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:13 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:13.466174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f2e4ed22-13f9-4375-b596-00ca782acb80 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2cdc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:13.514137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f2e4ed22-13f9-4375-b596-00ca782acb80 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052530 Nov 19 20:14:13.515013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2056/4159] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:13 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:14.315106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:14.315752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:14.323292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:14.323292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:14.323542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:14.324010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:14.462795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:14.473720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7efe6bee-a568-47a5-ae21-512d804889ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162001 Nov 19 20:14:14.474478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2104/4160] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:14.527803 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dc7ecf5c-58e8-4740-bbb0-d74007766904 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:14.573582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dc7ecf5c-58e8-4740-bbb0-d74007766904 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.049876 Nov 19 20:14:14.574163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2057/4161] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:14 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:15.491919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:15.492498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:15.499311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:15.499733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:15.500546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:15.500949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:15.586951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ceed02bc-7ff7-4092-bb07-9e3a919f7f0a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849fee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:15.635185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ceed02bc-7ff7-4092-bb07-9e3a919f7f0a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052768 Nov 19 20:14:15.635802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2058/4162] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:15 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:15.647398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:15.655652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5aaf395-c940-40d3-94c0-7064f47c4bf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167530 Nov 19 20:14:15.656200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2105/4163] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:15 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:16.648522 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-15ac9eff-76a8-47b8-ac4a-ac3e25a7b8b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbee040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:16.672612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:16.673196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:16.680060 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:16.680513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:16.681296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:16.681730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:16.697344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-15ac9eff-76a8-47b8-ac4a-ac3e25a7b8b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053170 Nov 19 20:14:16.697887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2059/4164] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:16 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:16.831379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:16.840849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-67572dab-1a16-449c-b49b-aaf221ba7611 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171918 Nov 19 20:14:16.841400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2106/4165] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:16 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:17.718365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fc2b43fe-edc6-45ed-881f-a1bc494329de tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849f700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:17.771516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fc2b43fe-edc6-45ed-881f-a1bc494329de tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058994 Nov 19 20:14:17.772119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2060/4166] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:17 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:17.859034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:17.859627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:17.866595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:17.867045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:17.867816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:17.868248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:18.018553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:18.027113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9aff9d01-daf5-4419-9534-e1edf9fcc6f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171790 Nov 19 20:14:18.027697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2107/4167] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:17 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:18.785018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0693ba10-8b88-4f49-8761-8a76f4acd89b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:18.838914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0693ba10-8b88-4f49-8761-8a76f4acd89b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057960 Nov 19 20:14:18.839496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2061/4168] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:18 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:19.044633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:19.045246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:19.051632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:19.052074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:19.052826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:19.053274 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:19.189753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:19.199493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-559d713f-167a-415f-8deb-0e13f48de2ec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.158848 Nov 19 20:14:19.200061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2108/4169] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:19.855132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cd093146-78a0-47a5-a998-8a910020ec6c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbee3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:19.907874 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cd093146-78a0-47a5-a998-8a910020ec6c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059380 Nov 19 20:14:19.909002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2062/4170] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:19 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:20.142844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:14:20.143424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:14:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:14:20.218738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:20.219336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:20.226235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:20.226677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:20.227450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:20.227874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:20.368103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:20.376277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0357e876-6c98-45d4-b771-5c1c0d53943b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162531 Nov 19 20:14:20.376799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2109/4171] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:20 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:20.921617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a0e4fa5e-1a65-41cc-81ff-5c44ade6ba9e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb325e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:20.968697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a0e4fa5e-1a65-41cc-81ff-5c44ade6ba9e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051369 Nov 19 20:14:20.969241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2063/4172] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:20 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:21.393324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:21.393957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:21.402538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:21.402984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:21.403756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:21.404189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:21.549690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:21.561821 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1598b8c-5bad-4948-89ca-6cd86b13a619 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171966 Nov 19 20:14:21.562591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2110/4173] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:21.987257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d72773fe-758f-4432-9029-655de0d39a5c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb421f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:22.042191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d72773fe-758f-4432-9029-655de0d39a5c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061267 Nov 19 20:14:22.042749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2064/4174] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:21 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:22.581496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:22.582112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:22.591293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:22.591744 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:22.594362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:22.594825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:22.745806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:22.754094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d15dd1bf-6212-4dbc-a287-e2ca83b3cfd8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176201 Nov 19 20:14:22.754802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2111/4175] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:22 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:23.057729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6f51121d-a592-4fcb-a216-114fb6fa59c5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:23.108920 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6f51121d-a592-4fcb-a216-114fb6fa59c5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057378 Nov 19 20:14:23.109474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2065/4176] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:23 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:23.770971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:23.771578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:23.778926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:23.779237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:23.780042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:23.780469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:23.949286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:23.960865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ea352e3-584a-4b11-b626-8bcd5d18d4ff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.193704 Nov 19 20:14:23.961748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2112/4177] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:23 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:14:24.124065 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5222dd81-2ae1-4a7a-af0a-71102e4fdbba tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:24.181643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5222dd81-2ae1-4a7a-af0a-71102e4fdbba tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061931 Nov 19 20:14:24.182531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2066/4178] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:24 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:24.985337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:24.985924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:24.993498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:24.993951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:24.994793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:24.995225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:25.197401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e121f82-0a35-40a4-8250-13f9206f5598 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:25.215233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:25.223496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af7fded3-c1ad-4477-8dd7-609eb728d69d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.243703 Nov 19 20:14:25.224073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2113/4179] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:24 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:25.253684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e121f82-0a35-40a4-8250-13f9206f5598 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060553 Nov 19 20:14:25.254908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2067/4180] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:25 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:26.241037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:26.241627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:26.248736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:26.249183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:26.249954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:26.250416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:26.266919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f0924c8-8a81-421d-a729-698886c41430 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:26.314287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f0924c8-8a81-421d-a729-698886c41430 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051406 Nov 19 20:14:26.315102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2068/4181] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:26 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:26.394995 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:26.403157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c11e2b19-671e-422d-9fb7-04af43765720 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166012 Nov 19 20:14:26.403703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2114/4182] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:26 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:27.328265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-73eccca8-abf7-47a3-8f72-04ce5b42cb17 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb325e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:27.382689 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-73eccca8-abf7-47a3-8f72-04ce5b42cb17 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058468 Nov 19 20:14:27.383287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2069/4183] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:27 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:27.427143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:27.427797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:27.441072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:27.441518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:27.442354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:27.442788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:27.605122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:27.613576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a273614e-4a11-4b39-bae7-6b5555ff26e3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.192976 Nov 19 20:14:27.614145 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2115/4184] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:28.397081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4b71a83c-6f5e-4673-80ab-7a17e83fc2c8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42f70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:28.452849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4b71a83c-6f5e-4673-80ab-7a17e83fc2c8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059898 Nov 19 20:14:28.453416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2070/4185] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:28 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:28.631322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:28.631874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:28.639331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:28.639777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:28.640551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:28.640978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:28.782751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:28.795836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cb77bcf8-5b75-4882-942d-56067f4ea71a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168311 Nov 19 20:14:28.796472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2116/4186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:28 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:29.467102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0aeb070a-55de-4102-ab2a-ecfca7e8f366 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:29.519772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0aeb070a-55de-4102-ab2a-ecfca7e8f366 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057863 Nov 19 20:14:29.520451 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2071/4187] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:29 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:14:29.815231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:29.815930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:29.823165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:29.823616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:29.824449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:29.824883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:29.991378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:30.000092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a653042-e6fc-463c-9fb7-e19df742d83c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188637 Nov 19 20:14:30.000651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2117/4188] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:29 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:30.532482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-724c63a6-3c9b-4682-a93b-5e64fc2fcca6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:30.581549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-724c63a6-3c9b-4682-a93b-5e64fc2fcca6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053183 Nov 19 20:14:30.582140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2072/4189] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:30 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:31.018272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:31.018964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:31.028624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:31.029228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:31.030157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:31.030648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:31.173765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:31.182507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f7eead28-7449-4471-943e-b3cc01d511dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168065 Nov 19 20:14:31.183237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2118/4190] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:31 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:31.598686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-80323d70-9445-404c-826c-6a9a698e2ad0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:31.661152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-80323d70-9445-404c-826c-6a9a698e2ad0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.069619 Nov 19 20:14:31.661712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2073/4191] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:31 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:32.202649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:32.203224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:32.212229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:32.213738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:32.214868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:32.215503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:32.392721 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:32.403653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fc6e6dc9-38d8-4b10-8b18-9dcb64cd5df1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.204657 Nov 19 20:14:32.404215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2119/4192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:32 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:32.674808 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-970be6db-8db8-426f-b281-d0cf5303bbf4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:32.728471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-970be6db-8db8-426f-b281-d0cf5303bbf4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058029 Nov 19 20:14:32.729194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2074/4193] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:32 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:33.421153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:33.421753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:33.428214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:33.428658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:33.429421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:33.429847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:33.573411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:33.582375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bedeee3a-86c4-4565-a5ce-bc5dcafbf796 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164837 Nov 19 20:14:33.582963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2120/4194] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:33 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:33.741658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-95818b37-a5bf-436e-be30-9ff057ef414a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:33.789190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-95818b37-a5bf-436e-be30-9ff057ef414a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051661 Nov 19 20:14:33.789772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2075/4195] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:33 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:34.601026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:34.601629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:34.608808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:34.609256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:34.610037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:34.610502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:34.748866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:34.757431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d0f7791-f64b-416e-afc6-2d3a76829599 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160264 Nov 19 20:14:34.758016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2121/4196] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:34 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:34.802704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6d5f91b6-9411-41c6-abc9-f2b7db32e1cc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:34.850323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6d5f91b6-9411-41c6-abc9-f2b7db32e1cc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051645 Nov 19 20:14:34.850902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2076/4197] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:34 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:14:35.775313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:35.776022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:35.783620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:35.784063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:35.784841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:35.785264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:35.866334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be26738f-6b50-4f25-adcf-110d4dba5c62 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:35.917366 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be26738f-6b50-4f25-adcf-110d4dba5c62 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056695 Nov 19 20:14:35.918178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2077/4198] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:35 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:14:35.928859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:35.937242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fa8be4f7-0b59-40ed-8ec2-b1c79bbf9ce8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165733 Nov 19 20:14:35.937779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2122/4199] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:35 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:36.934349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6ad059f-9f5b-43ef-b916-7d6638c81640 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb224c0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:36.955411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:36.956042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:36.963090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:36.963580 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:36.964416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:36.965078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:36.989930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6ad059f-9f5b-43ef-b916-7d6638c81640 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062236 Nov 19 20:14:36.995204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2078/4200] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:36 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:37.112492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:37.121653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0f4fa97f-2efe-4c51-a493-2df8f50c19f7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170427 Nov 19 20:14:37.122260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2123/4201] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:36 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:38.003705 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2b054f80-d576-43f9-ba20-f82de434da39 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcf70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:38.053392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2b054f80-d576-43f9-ba20-f82de434da39 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054209 Nov 19 20:14:38.054031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2079/4202] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:37 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:38.143473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:38.144027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:38.151162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:38.151622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:38.152407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:38.152832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:38.310151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:38.318713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-18ceaae9-d6c2-49c7-b9fb-fa5c54d73d50 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179148 Nov 19 20:14:38.319361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2124/4203] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:38 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:39.066502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-09ebb109-2ac0-4964-b178-f0eaf0f3c644 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2cca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:39.115464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-09ebb109-2ac0-4964-b178-f0eaf0f3c644 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053445 Nov 19 20:14:39.116170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2080/4204] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:39 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:39.336835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:39.337610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:39.345514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:39.345956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:39.346775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:39.347195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:39.488324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:39.497026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-095db117-1a88-4a2e-a767-1cb204871797 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164422 Nov 19 20:14:39.497634 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2125/4205] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:39 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:40.132172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-22f178ad-2b93-47b5-8214-4d9c6e628822 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:40.183497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-22f178ad-2b93-47b5-8214-4d9c6e628822 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058378 Nov 19 20:14:40.184064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2081/4206] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:40 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:40.514936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:40.515623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:40.522703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:40.523156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:40.523935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:40.524367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:40.674918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:40.684408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-33140df4-3f94-4ed3-9ef7-89ed2e5cf3a6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173359 Nov 19 20:14:40.685624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2126/4207] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:40 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:41.197208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d9cc5be6-7a00-457d-b1d2-de056d24b5fb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc160>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:41.255033 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d9cc5be6-7a00-457d-b1d2-de056d24b5fb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061946 Nov 19 20:14:41.255568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2082/4208] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:41 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:41.703175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:41.703846 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:41.710622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:41.711069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:41.712157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:41.712593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:41.871942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:41.880446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8f74a07-c33a-4a99-a89a-9e23a60703bf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181355 Nov 19 20:14:41.881023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2127/4209] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:41 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:42.268796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-594ff69b-2e4f-405f-a551-cbe344cf9f48 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:42.323125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-594ff69b-2e4f-405f-a551-cbe344cf9f48 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059412 Nov 19 20:14:42.324069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2083/4210] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:42 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:42.898310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:42.898918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:42.905601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:42.906068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:42.906872 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:42.907297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:43.056990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:43.066386 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eda9a2a5-e197-4dc5-96cb-f284c066f9da tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171715 Nov 19 20:14:43.066958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2128/4211] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:42 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:14:43.337626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9df71438-af35-42f0-8597-ac9fc7aaa2e4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:43.391372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9df71438-af35-42f0-8597-ac9fc7aaa2e4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058079 Nov 19 20:14:43.391940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2084/4212] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:43 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:44.085787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:44.087087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:44.094553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:44.095025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:44.095802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:44.096233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:44.240604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:44.248896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3a6750ec-7af0-4769-9704-a47a65f2885e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166815 Nov 19 20:14:44.249471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2129/4213] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:44 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:44.404677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f0bb28d0-05cf-4331-95b9-355bf6b55574 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42ee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:44.454541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f0bb28d0-05cf-4331-95b9-355bf6b55574 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053964 Nov 19 20:14:44.455118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2085/4214] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:44 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:45.267013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:45.267636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:45.274730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:45.275205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:45.275997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:45.276464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:45.429337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:45.440172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32fd1bf1-2248-411b-824f-15ed5f3c71ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177464 Nov 19 20:14:45.440755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2130/4215] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:45 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:45.468643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c01002eb-77f5-4fa4-a2f2-c1db87c87806 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:45.520843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c01002eb-77f5-4fa4-a2f2-c1db87c87806 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056912 Nov 19 20:14:45.521445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2086/4216] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:45 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:46.457207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:46.457782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:46.465168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:46.465606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:46.466441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:46.466870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:46.533634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ead0361b-5485-4d3e-9719-c3296f122d89 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c9d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:46.585402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ead0361b-5485-4d3e-9719-c3296f122d89 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056327 Nov 19 20:14:46.591066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2087/4217] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:46 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:14:46.628693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:46.639710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-13a7cb73-c3bf-417e-8163-52a143e0f2ad tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.186321 Nov 19 20:14:46.640303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2131/4218] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:46 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:47.598531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fd6c42b4-68b5-40c8-9067-0b31b16b7d52 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc1f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:47.652381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fd6c42b4-68b5-40c8-9067-0b31b16b7d52 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056069 Nov 19 20:14:47.652381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2088/4219] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:47 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:47.661546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:47.662674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:47.672468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:47.673041 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:47.674072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:47.674807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:47.824132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:47.833364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0d868c4d-72bc-45ef-92ed-ccfe79775550 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179136 Nov 19 20:14:47.834322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2132/4220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:47 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:48.667165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d6825b14-d9b1-4f91-9558-ca4ff033e56a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:48.723456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d6825b14-d9b1-4f91-9558-ca4ff033e56a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060070 Nov 19 20:14:48.724198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2089/4221] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:48 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:48.851479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:48.852103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:48.858803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:48.859416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:48.860216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:48.860648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:49.009323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:49.018768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-28b491ab-8a30-4d6e-8a44-720e4e15de27 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170994 Nov 19 20:14:49.019359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2133/4222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:48 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:49.737587 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c091ffbb-ab80-4b86-8cc8-0305fde29a27 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:49.807592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c091ffbb-ab80-4b86-8cc8-0305fde29a27 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.074368 Nov 19 20:14:49.808174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2090/4223] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:49 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:50.045372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:50.046518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:50.053665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:50.054601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:50.055899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:50.056662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:50.215148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:50.224760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cd9c8abe-f924-4efe-bc15-ab32896fd385 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.183594 Nov 19 20:14:50.225789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2134/4224] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:50 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:50.824941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cb2850e7-4f83-4379-9761-4f0bb4a1bcd8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:50.875819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cb2850e7-4f83-4379-9761-4f0bb4a1bcd8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058889 Nov 19 20:14:50.883024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2091/4225] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:51.241879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:51.242497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:51.249464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:51.249984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:51.250866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:51.251353 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:51.394226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:51.402559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b8d5698-31f9-4121-92cd-de2973abc488 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164253 Nov 19 20:14:51.403135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2135/4226] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:51 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:51.890905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-58350266-e059-4284-903e-e1ed30bb7bf3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14831cca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:51.941035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-58350266-e059-4284-903e-e1ed30bb7bf3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054260 Nov 19 20:14:51.941754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2092/4227] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:51 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:52.420570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:52.421151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:52.429593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:52.430451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:52.431519 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:52.432153 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:52.590620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:52.603105 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fa9d817c-68a2-425e-a12a-8b39064a5572 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.185955 Nov 19 20:14:52.603843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2136/4228] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:52 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:52.958120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e04ce13-d44b-4199-9c93-ea0eca2d219d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:53.018616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e04ce13-d44b-4199-9c93-ea0eca2d219d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.067261 Nov 19 20:14:53.019195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2093/4229] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:53.624709 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:53.625398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:53.634719 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:53.635337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:53.636436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:53.637026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:53.777081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:53.786211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3060dc40-e89b-4737-b43a-d8eca1591696 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166885 Nov 19 20:14:53.786751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2137/4230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:53 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:54.031882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2c3bc19e-345d-45eb-aad8-569c0f636a82 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc1f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:54.080347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2c3bc19e-345d-45eb-aad8-569c0f636a82 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052571 Nov 19 20:14:54.080929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2094/4231] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:54 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:54.803648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:54.804411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:54.811418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:54.811865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:54.812651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:54.813118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:54.962062 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:54.971289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ec868eb2-d8bd-44c8-96c9-21959c6ae5f6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171265 Nov 19 20:14:54.971875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2138/4232] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:54 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:55.094200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-389f0042-e67d-4500-9900-8d5bb8662183 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb595e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:55.142535 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-389f0042-e67d-4500-9900-8d5bb8662183 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052640 Nov 19 20:14:55.143166 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2095/4233] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:55 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:55.988534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:55.989131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:55.995418 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:55.995860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:55.996628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:55.997058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:56.133961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:56.142817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f50f061c-2086-4036-98c7-127ca486e60a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.158233 Nov 19 20:14:56.143477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2139/4234] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:55 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:56.155324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df889896-1aef-43b6-96f8-42d8d3a501cc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:56.202183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df889896-1aef-43b6-96f8-42d8d3a501cc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051077 Nov 19 20:14:56.202751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2096/4235] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:56 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:57.160962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:57.161689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:57.168804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:57.169249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:57.170035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:57.170531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:57.215350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6ba91b2-e381-4e82-be2a-e700780963e3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c8b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:57.265130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6ba91b2-e381-4e82-be2a-e700780963e3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053975 Nov 19 20:14:57.265821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2097/4236] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:57 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:57.316391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:57.328513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bbe4db82-ed46-4314-a15b-86c7edc877b7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171312 Nov 19 20:14:57.329123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2140/4237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:57 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:58.278256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-322e197f-7587-42c0-8c02-af5b6cf89b09 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:58.328090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-322e197f-7587-42c0-8c02-af5b6cf89b09 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054098 Nov 19 20:14:58.328678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2098/4238] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:58 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:58.347168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:58.347625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:58.354553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:58.355005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:58.355786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:58.356229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:58.495144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:58.504502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6def2993-183c-4553-b70b-9bd7e6ba2706 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.161530 Nov 19 20:14:58.505045 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2141/4239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:58 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:14:59.344921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e009d9bb-bbf9-4354-a96a-dfa47da7036c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:59.396532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e009d9bb-bbf9-4354-a96a-dfa47da7036c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057917 Nov 19 20:14:59.397105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2099/4240] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:14:59 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:14:59.527182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:14:59.527750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:14:59.534720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:59.535166 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:59.535955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:14:59.536384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:14:59.675925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:14:59.685695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bed28e68-337e-43af-bc5b-860a0980a0c0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162140 Nov 19 20:14:59.686471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2142/4241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:14:59 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:00.410110 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46ae89b3-6f39-4663-9ca3-bc5d5b3ac0eb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc4c0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:00.460285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46ae89b3-6f39-4663-9ca3-bc5d5b3ac0eb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055079 Nov 19 20:15:00.460882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2100/4242] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:00 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:00.706792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:00.707364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:00.714588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:00.715033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:00.715810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:00.716314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:00.854265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:00.863234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d4de81f6-160f-4ef1-82b9-9c7a30df065d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160318 Nov 19 20:15:00.863820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2143/4243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:00 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:01.474286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df30ce64-21cc-4278-8232-49326d060559 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:01.524706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df30ce64-21cc-4278-8232-49326d060559 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054804 Nov 19 20:15:01.525883 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2101/4244] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:01 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:01.880970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:01.881604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:01.889740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:01.889740 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:01.890185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:01.890585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:02.037085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:02.046267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de36f167-7a9d-4408-82a9-088acf971234 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168946 Nov 19 20:15:02.046850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2144/4245] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:01 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:02.538147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7c822959-281a-4fe7-8988-d509e1611f4b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:02.587603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7c822959-281a-4fe7-8988-d509e1611f4b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053131 Nov 19 20:15:02.588155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2102/4246] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:02 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:03.063582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:03.064221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:03.071056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:03.071501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:03.072268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:03.072699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:03.207112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:03.218467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a5cb8b9-50de-4baf-a00c-a9d048f49d90 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.158604 Nov 19 20:15:03.219070 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2145/4247] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:03 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:03.603999 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-359a1003-9819-4583-a024-881be83761cb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:03.652293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-359a1003-9819-4583-a024-881be83761cb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054636 Nov 19 20:15:03.652939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2103/4248] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:03 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:04.236370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:04.237451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:04.244981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:04.245615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:04.246423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:04.246857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:04.395654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:04.406971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2285719c-4492-4d7e-ab1c-91ee94ac1f5e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.174639 Nov 19 20:15:04.407769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2146/4249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:04 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:04.666015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dc1e20ce-4297-430a-ab80-0941c5e9e6f9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d08b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:04.716994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dc1e20ce-4297-430a-ab80-0941c5e9e6f9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054847 Nov 19 20:15:04.717770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2104/4250] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:04 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:05.426837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:05.427393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:05.433855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:05.434339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:05.435112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:05.435543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:05.582112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:05.591621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b3198e39-c3f0-4308-ab10-30a2b9d73ff5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168671 Nov 19 20:15:05.592178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2147/4251] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:05 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:05.731947 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-57113eaf-f832-4506-a285-4b76c272a118 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:05.783282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-57113eaf-f832-4506-a285-4b76c272a118 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055531 Nov 19 20:15:05.783843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2105/4252] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:05 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:06.613278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:06.613914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:06.620991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:06.621448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:06.622266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:06.622701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:06.796356 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-33cdd125-fe47-4af4-8cde-fdab223648fe tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:06.852933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-33cdd125-fe47-4af4-8cde-fdab223648fe tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060995 Nov 19 20:15:06.853582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2106/4253] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:06 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:07.010931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:07.024063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b79b858f-5631-4b50-b7df-5803170779e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.414628 Nov 19 20:15:07.024636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2148/4254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:06 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:07.865799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e83b600c-27d1-4016-899f-e1e16f430c38 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30a60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:07.912052 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e83b600c-27d1-4016-899f-e1e16f430c38 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050709 Nov 19 20:15:07.912618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2107/4255] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:07 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:08.041948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:08.042620 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:08.049444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:08.049898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:08.050682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:08.051135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:08.189631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:08.197936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3108dd46-1e97-4443-8a67-663c2f735bd0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.159771 Nov 19 20:15:08.198600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2149/4256] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:08 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:08.925242 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4fa9e666-fb8a-470b-a1ad-1bf02ca6a69f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc5e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:08.971239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4fa9e666-fb8a-470b-a1ad-1bf02ca6a69f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050127 Nov 19 20:15:08.971820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2108/4257] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:08 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:09.215839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:09.216402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:09.223093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:09.223545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:09.224290 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:09.224739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:09.366269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:09.374394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ca427d7-7652-42fa-9a35-939830529eca tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162794 Nov 19 20:15:09.374962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2150/4258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:09 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:09.988674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-115f7d5f-1e35-4139-b80b-38c0146a3d13 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:10.038292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-115f7d5f-1e35-4139-b80b-38c0146a3d13 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056045 Nov 19 20:15:10.038891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2109/4259] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:09 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:10.395355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:10.395897 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:10.403198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:10.403641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:10.404398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:10.404829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:10.545017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:10.553718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-855023e6-2d19-44c7-b8a1-1927db06f82a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164208 Nov 19 20:15:10.554505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2151/4260] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:10 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:11.054422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8c0fa78-3d46-4c35-8fce-62abe98b629b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:11.107180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8c0fa78-3d46-4c35-8fce-62abe98b629b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058586 Nov 19 20:15:11.107870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2110/4261] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:11 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:11.681184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:11.681825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:11.690710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:11.691339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:11.692487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:11.693162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:11.840405 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:11.852358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c4505979-5075-45c0-8df6-9d378513391f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.284520 Nov 19 20:15:11.852911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2152/4262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:11 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:12.121766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aea011fd-dc30-4e5f-bd48-20f0bd04336b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30af0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:12.167419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aea011fd-dc30-4e5f-bd48-20f0bd04336b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.049759 Nov 19 20:15:12.168018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2111/4263] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:12 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:12.869890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:12.870585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:12.877561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:12.878005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:12.878816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:12.879246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:13.022664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:13.031717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ed5643d-35f2-46f8-b6ad-6df429c409c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166447 Nov 19 20:15:13.032295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2153/4264] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:12 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:13.181493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d59d9809-fdff-49f9-9a62-abc9bce015e1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:13.235525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d59d9809-fdff-49f9-9a62-abc9bce015e1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058837 Nov 19 20:15:13.236124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2112/4265] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:13 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:14.051133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:14.051828 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:14.060585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:14.061033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:14.061816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:14.062330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:14.215761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:14.224365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f20769a7-e27c-457c-9317-b2fa76fa5df4 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179000 Nov 19 20:15:14.224869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2154/4266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:14.248783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2732ed12-ae89-4e6f-9274-66566e2a8f4d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca408b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:14.301259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2732ed12-ae89-4e6f-9274-66566e2a8f4d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056602 Nov 19 20:15:14.301809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2113/4267] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:14 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:15.243134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:15.243760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:15.251053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:15.251496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:15.252276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:15.252700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:15.313459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e0b84b23-9179-4887-adfd-d95dc26b30bf tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caabc10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:15.368811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e0b84b23-9179-4887-adfd-d95dc26b30bf tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059211 Nov 19 20:15:15.374173 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2114/4268] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:15 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:15:15.399146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:15.406988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-86e20ac5-75f2-4ccb-a732-ddb718a3512c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167634 Nov 19 20:15:15.407528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2155/4269] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:15 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:16.382256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b162a697-7cc3-4aed-b7e4-573e647a5e94 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30a60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:16.424092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:16.424704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:16.432623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:16.432900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b162a697-7cc3-4aed-b7e4-573e647a5e94 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054735 Nov 19 20:15:16.433097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:16.433459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2115/4270] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:16 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:16.434327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:16.434787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:16.589862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:16.598256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e253301-744f-4c19-83ed-9fd8be06fe21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177716 Nov 19 20:15:16.598815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2156/4271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:16 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:17.448564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c3417189-9e30-4bdc-807e-3f5ab2516752 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:17.502266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c3417189-9e30-4bdc-807e-3f5ab2516752 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060124 Nov 19 20:15:17.503046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2116/4272] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:17 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:17.615746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:17.616345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:17.623570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:17.624033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:17.624801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:17.625264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:17.780635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:17.788633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-145809bc-a1a6-4fbf-8ef8-618a80ab8d55 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176702 Nov 19 20:15:17.789213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2157/4273] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:17 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:18.515394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-951c7281-bbd3-4417-93f8-b9e5105ff9b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30ee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:18.562530 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-951c7281-bbd3-4417-93f8-b9e5105ff9b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051194 Nov 19 20:15:18.563102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2117/4274] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:18 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:18.806624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:18.807355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:18.813921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:18.814407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:18.815168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:18.815590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:18.954779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:18.967149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-126d6fe2-d9b2-433a-a982-6443c1a90bb8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164522 Nov 19 20:15:18.967810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2158/4275] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:18 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:19.576767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3272c523-4be1-4a3a-ae99-405c2b8c8d88 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:19.628832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3272c523-4be1-4a3a-ae99-405c2b8c8d88 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056706 Nov 19 20:15:19.629419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2118/4276] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:19 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:19.988774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:19.989387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:19.995825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:19.996262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:19.997033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:19.997457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:20.139203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:20.147637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-43a2f402-c2f9-4734-80ed-ff5312978a63 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163069 Nov 19 20:15:20.148276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2159/4277] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:20.641569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9dd2d0fa-3fd6-4f8c-9775-aea73db4ffcd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb591f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:20.689512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9dd2d0fa-3fd6-4f8c-9775-aea73db4ffcd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052394 Nov 19 20:15:20.690295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2119/4278] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:20 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:21.165017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:21.165588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:21.173052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:21.173488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:21.174293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:21.174724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:21.321935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:21.331733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0c276545-d247-4531-9c69-c8fc4b73d029 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170488 Nov 19 20:15:21.332341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2160/4279] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:21.705771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ca09aef4-e7ba-40b0-95b0-e64a7e97ebfa tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caabc10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:21.755011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ca09aef4-e7ba-40b0-95b0-e64a7e97ebfa tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055522 Nov 19 20:15:21.755566 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2120/4280] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:21 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:22.353595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:22.354240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:22.361601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:22.362080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:22.362856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:22.363287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:22.514599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:22.525201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-baf0093e-e487-4a48-aea2-85a521e24374 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.175446 Nov 19 20:15:22.525765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2161/4281] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:22 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:22.768098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3470d82e-4060-46aa-8c5b-ccd532e3654a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:22.815261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3470d82e-4060-46aa-8c5b-ccd532e3654a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051332 Nov 19 20:15:22.816000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2121/4282] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:22 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:23.544847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:23.545467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:23.552306 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:23.552754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:23.553525 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:23.553957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:23.706758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:23.719777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e59aa3b1-2838-436d-bff4-c24420c5ef8c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178654 Nov 19 20:15:23.720598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2162/4283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:23 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:23.830105 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3664eea5-b2f2-46d9-8b98-a98473e4189e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849f310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:23.878191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3664eea5-b2f2-46d9-8b98-a98473e4189e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052376 Nov 19 20:15:23.878944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2122/4284] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:23 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:24.741728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:24.742378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:24.749713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:24.750197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:24.750957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:24.751380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:24.892251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3f2dcbab-ad6a-4a32-a25a-780b48e13fe5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30f70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:24.895140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:24.903677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ea1b735-51a7-4f15-8902-5ec2e91645f3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165701 Nov 19 20:15:24.904886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2163/4285] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:24 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:24.940095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3f2dcbab-ad6a-4a32-a25a-780b48e13fe5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052309 Nov 19 20:15:24.940659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2123/4286] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:24 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:15:25.920868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:25.921484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:25.928239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:25.928681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:25.929444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:25.929865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:25.952685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ff40eab1-3315-4d37-b71f-ddbd5baaef46 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d03a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:26.000551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ff40eab1-3315-4d37-b71f-ddbd5baaef46 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052384 Nov 19 20:15:26.001406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2124/4287] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:25 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:26.068742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:26.077278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-120498d8-442b-4aa9-8158-29cf9e67c5c2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160207 Nov 19 20:15:26.077874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2164/4288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:25 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:27.013191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-48ed54da-75ff-4a1c-a1fa-f673ac0c9d27 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:27.066732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-48ed54da-75ff-4a1c-a1fa-f673ac0c9d27 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057651 Nov 19 20:15:27.067562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2125/4289] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:27 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:27.094318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:27.095678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:27.103567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:27.104011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:27.104782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:27.105239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:27.340071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:27.350636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-15a5fbe7-5a87-4e26-84ad-64e2e42b938b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.260079 Nov 19 20:15:27.351228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2165/4290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:28.080349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7aa4a5e2-c53c-4dad-972b-954719092f63 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:28.136298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7aa4a5e2-c53c-4dad-972b-954719092f63 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060050 Nov 19 20:15:28.137128 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2126/4291] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:28 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:28.372143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:28.372977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:28.380108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:28.380555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:28.381379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:28.381803 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:28.528261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:28.542112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-242a89c8-635c-47fb-854b-fe3b108ffbaf tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.175617 Nov 19 20:15:28.543099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2166/4292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:28 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:29.150738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8020940-c9b7-4141-bf5e-ee4f65ed37d6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:29.201482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8020940-c9b7-4141-bf5e-ee4f65ed37d6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056345 Nov 19 20:15:29.202417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2127/4293] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:29 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:29.566965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:29.567605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:29.575383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:29.575829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:29.576652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:29.577048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:29.745075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:29.756742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-90511a6d-2152-4c36-9e02-72de1b4b0253 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.194858 Nov 19 20:15:29.757502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2167/4294] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:29 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:30.216188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c32428e7-52c4-4409-a214-361729dc0d0e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:30.269140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c32428e7-52c4-4409-a214-361729dc0d0e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058384 Nov 19 20:15:30.269743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2128/4295] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:30 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:30.777409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:30.778011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:30.785893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:30.786439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:30.787628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:30.788220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:30.951439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:30.960403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f8b22750-9f14-430e-85ef-0a489c97521b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.186674 Nov 19 20:15:30.960997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2168/4296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:30 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:31.282155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6f7ddabc-09da-40f7-bb84-8fa077832b0b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849fa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:31.340960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6f7ddabc-09da-40f7-bb84-8fa077832b0b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062457 Nov 19 20:15:31.341933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2129/4297] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:31 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:31.984243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:31.984819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:31.992409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:31.992890 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:31.993674 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:31.994147 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:32.136018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:32.144742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ccccb24-c198-46d0-967f-3069cc5b9d51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164653 Nov 19 20:15:32.145341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2169/4298] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:31 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:32.357497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0c4c54e-249e-42f0-8de2-3e5dec18299e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:32.404921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0c4c54e-249e-42f0-8de2-3e5dec18299e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053307 Nov 19 20:15:32.405480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2130/4299] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:32 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:33.165745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:33.166587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:33.175275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:33.175723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:33.176495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:33.176927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:33.213654 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:15:33.213927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:15:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:15:33.344683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:33.354465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-059b841d-131a-44f8-b1e8-c4efde182145 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.194937 Nov 19 20:15:33.355046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2170/4300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:33 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:33.418388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c8542440-99f7-4be7-ad76-bcf53f2283fd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:33.471467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c8542440-99f7-4be7-ad76-bcf53f2283fd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058438 Nov 19 20:15:33.472053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2131/4301] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:33 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:34.374218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:34.374822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:34.381660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:34.382204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:34.382989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:34.383422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:34.484379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c12fadb4-06de-492a-ab74-9252e6eea628 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:34.532952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:34.535281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c12fadb4-06de-492a-ab74-9252e6eea628 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054655 Nov 19 20:15:34.536685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2132/4302] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:34 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:34.544743 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bfe96702-afe3-498d-9a59-62e4968d4198 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.174228 Nov 19 20:15:34.545409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2171/4303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:34 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:35.549169 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ad514728-92c4-46e0-9fa8-96b3370e29a8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2cd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:35.562902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:35.563444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:35.570853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:35.571302 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:35.572120 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:35.572565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:35.600930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ad514728-92c4-46e0-9fa8-96b3370e29a8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056112 Nov 19 20:15:35.601671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2133/4304] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:35 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:35.738648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:35.747238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d678289-4cd5-4e51-8b8e-e4fb7ea9fd49 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188840 Nov 19 20:15:35.747588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2172/4305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:35 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:36.616700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e9ee5d63-4f2e-43be-a137-5139082ceb1a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:36.667386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e9ee5d63-4f2e-43be-a137-5139082ceb1a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056930 Nov 19 20:15:36.667942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2134/4306] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:36 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:36.773478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:36.774110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:36.780552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:36.781001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:36.781778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:36.782268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:36.783222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:15:36.783222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:15:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:15:36.923660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:36.932527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-41c0df8e-1136-4093-80d4-db6937756fa6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163186 Nov 19 20:15:36.933088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2173/4307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:36 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:37.683592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8829cdd6-fb28-4e25-936a-0f0990a43a11 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb328b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:37.735088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8829cdd6-fb28-4e25-936a-0f0990a43a11 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057826 Nov 19 20:15:37.735902 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2135/4308] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:37 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:37.950614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:37.951250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:37.958649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:37.959102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:37.959889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:37.960318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:38.120184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:38.129783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aba906a9-f7a0-4746-ac9d-84de34030f99 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.183093 Nov 19 20:15:38.130365 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2174/4309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:37 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:38.749688 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fb329320-28b4-49b9-93bb-3ef878268ab8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb40a60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:38.804095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fb329320-28b4-49b9-93bb-3ef878268ab8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058850 Nov 19 20:15:38.804678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2136/4310] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:38 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:39.150245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:39.150855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:39.157521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:39.157965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:39.158753 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:39.159225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:39.312038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:39.324295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-441e121d-7279-4088-9870-38a1d23995c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179008 Nov 19 20:15:39.324906 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2175/4311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:39 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:39.817261 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-759bfdfc-c41f-43f8-9ed2-184b3694eb40 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:39.871412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-759bfdfc-c41f-43f8-9ed2-184b3694eb40 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058427 Nov 19 20:15:39.872145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2137/4312] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:39 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:40.346225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:40.347199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:40.357463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:40.358110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:40.359246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:40.359892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:40.511820 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:40.525554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-74d7da88-de7a-458e-ac05-3d1f98f68be9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.185259 Nov 19 20:15:40.526502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2176/4313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:40 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:15:40.885611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b7b89170-51ba-4030-bde3-81a26942e6ef tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:40.937977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b7b89170-51ba-4030-bde3-81a26942e6ef tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056925 Nov 19 20:15:40.938613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2138/4314] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:40 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:41.544282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:41.544883 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:41.551947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:41.552444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:41.553360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:41.553807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:41.699945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:41.709485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-764c4c3f-df0d-48e1-97ff-4c81646bb53d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169638 Nov 19 20:15:41.710154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2177/4315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:41 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:41.952331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0d3c5d62-b40b-4883-be11-f3a95fb003b7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb223a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:42.011542 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0d3c5d62-b40b-4883-be11-f3a95fb003b7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.063326 Nov 19 20:15:42.012098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2139/4316] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:41 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:42.730500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:42.731187 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:42.740888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:42.741403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:42.742534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:42.743127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:42.887470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:42.895422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5ca9e662-e4b8-4b79-834c-8f07da7c173f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170957 Nov 19 20:15:42.895957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2178/4317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:42 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:43.027893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-01632484-9e51-4c9d-81eb-e8d26987bc44 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:43.077870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-01632484-9e51-4c9d-81eb-e8d26987bc44 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057586 Nov 19 20:15:43.078515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2140/4318] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:43 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:43.915941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:43.916614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:43.923564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:43.924016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:43.924790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:43.925206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:44.078917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:44.090235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6998103d-d3ae-4171-b14d-70b0f7eeed74 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.180248 Nov 19 20:15:44.090819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2179/4319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:43 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:44.092679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-39bee648-d6c5-4737-a7b6-adab04326d2f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb301f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:44.147570 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-39bee648-d6c5-4737-a7b6-adab04326d2f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059035 Nov 19 20:15:44.148203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2141/4320] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:44 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:15:45.108429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:45.109055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:45.116406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:45.116933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:45.117819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:45.118346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:45.161094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1dce0aa1-5a59-462f-9608-e9bf997c13b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6ee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:45.214814 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1dce0aa1-5a59-462f-9608-e9bf997c13b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057894 Nov 19 20:15:45.215732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2142/4321] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:45 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:15:45.266250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:45.274981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b02116a2-5e8f-4d9f-b1bd-d7f79b0d1807 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170847 Nov 19 20:15:45.284084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2180/4322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:45 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:46.229468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eaa5c25a-4ae4-442b-b257-28b2985f00fb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:46.282772 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eaa5c25a-4ae4-442b-b257-28b2985f00fb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057554 Nov 19 20:15:46.283472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2143/4323] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:46 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:46.293376 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:46.294200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:46.301065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:46.301544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:46.302345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:46.302774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:46.466494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:46.478419 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e53c7d0a-32d7-43e0-bd4a-22e3ef1592bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188703 Nov 19 20:15:46.479232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2181/4324] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:46 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:47.300599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4f3fdbb2-cd34-4103-9d65-bc55671979ed tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:47.357704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4f3fdbb2-cd34-4103-9d65-bc55671979ed tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.064033 Nov 19 20:15:47.358309 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2144/4325] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:47 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:47.502410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:47.503064 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:47.510776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:47.511191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:47.512081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:47.512539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:47.661231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:47.669767 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-65f108b5-12ca-4f33-9c02-0bcaf6841828 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172332 Nov 19 20:15:47.670428 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2182/4326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:47 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:48.372433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ac2f198-61f3-47c5-ac77-a5d303bdd9bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25a60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:48.426709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ac2f198-61f3-47c5-ac77-a5d303bdd9bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058343 Nov 19 20:15:48.427796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2145/4327] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:48 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:48.690858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:48.691461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:48.700763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:48.701435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:48.702762 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:48.703336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:48.870914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:48.879565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6d671cbd-7cf8-4cc8-b6d5-79c11483eed0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.194752 Nov 19 20:15:48.880223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2183/4328] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:48 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:49.441893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3dc5b08b-dcc8-4047-8680-0bdf8f05271e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6ee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:49.500834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3dc5b08b-dcc8-4047-8680-0bdf8f05271e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.064094 Nov 19 20:15:49.501550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2146/4329] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:49 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:49.861053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:15:49.861252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:15:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:15:49.898859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:49.899574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:49.906945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:49.907406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:49.908293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:49.908749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:50.076399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:50.089039 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef50a0a3-d1b1-4498-94b8-0cca2c93bf12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.193801 Nov 19 20:15:50.092179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2184/4330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:49 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:50.514528 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-03cac624-15a6-469a-abd6-935ec57fb706 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:50.565790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-03cac624-15a6-469a-abd6-935ec57fb706 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055498 Nov 19 20:15:50.566410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2147/4331] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:51.109628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:51.110354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:51.117119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:51.117568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:51.118384 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:51.118793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:51.261736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:51.275106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cadc89a8-db7c-4a8c-9e8a-f98839fa7ba1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168897 Nov 19 20:15:51.275891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2185/4332] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:51 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:51.579844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ae278658-87f5-4f70-91d9-8f1842116b49 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:51.626082 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ae278658-87f5-4f70-91d9-8f1842116b49 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050675 Nov 19 20:15:51.631156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2148/4333] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:51 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:52.295237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:52.295804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:52.302930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:52.303381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:52.304579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:52.304579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:52.449592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:52.460038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-abf65d53-55ad-48ba-aec2-78cb9c783ace tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168567 Nov 19 20:15:52.460638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2186/4334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:52 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:52.641597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-366cecd6-ed26-40c8-8822-5aca9fa672df tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d08b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:52.701431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-366cecd6-ed26-40c8-8822-5aca9fa672df tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.065810 Nov 19 20:15:52.701998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2149/4335] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:53.486200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:53.486806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:53.496941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:53.497622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:53.498676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:53.499212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:53.651023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:53.659928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-03df7873-b234-40bb-a07e-259b698cb9d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179459 Nov 19 20:15:53.660489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2187/4336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:53 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:53.717184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-56b1d764-e993-4245-986f-aabdc0a30a97 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2cf70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:53.769713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-56b1d764-e993-4245-986f-aabdc0a30a97 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058215 Nov 19 20:15:53.770564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2150/4337] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:53 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:54.677464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:54.678077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:54.684978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:54.685427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:54.686233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:54.686676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:54.783138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-82f82ee1-276d-4cea-9e20-d55ab2c6ef24 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d05e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:54.835169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:54.839941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-82f82ee1-276d-4cea-9e20-d55ab2c6ef24 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060835 Nov 19 20:15:54.840775 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2151/4338] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:54 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:54.843938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d79eec9a-9196-4b3f-b42d-ee1c663d231b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170269 Nov 19 20:15:54.844668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2188/4339] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:54 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:55.853700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-62880dad-2412-41ef-a7cc-b06968d0190b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada4c0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:55.860390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:55.861142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:55.868528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:55.868985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:55.869735 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:55.870226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:55.904465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-62880dad-2412-41ef-a7cc-b06968d0190b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055319 Nov 19 20:15:55.905312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2152/4340] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:55 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:56.017703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:56.029467 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-45fa721c-3dea-4e4c-b667-203661d05353 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172457 Nov 19 20:15:56.030459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2189/4341] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:55 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:56.921172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c4841fb6-1f41-43a4-a9b1-10de4e3663ff tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:56.976556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c4841fb6-1f41-43a4-a9b1-10de4e3663ff tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061142 Nov 19 20:15:56.980319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2153/4342] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:56 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:57.046934 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:57.048380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:57.055298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:57.055748 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:57.056741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:57.057173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:57.199177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:57.208076 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee9befc1-10ee-4d28-8165-80c6d89a718d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164912 Nov 19 20:15:57.208642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2190/4343] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:57 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:57.992394 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-39f89026-3353-458a-8034-5c2e4b8728bf tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada9d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:58.039785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-39f89026-3353-458a-8034-5c2e4b8728bf tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051465 Nov 19 20:15:58.040494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2154/4344] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:57 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:15:58.232948 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:58.234256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:58.241189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:58.241636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:58.242500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:58.242878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:58.392398 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:58.400790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e6d4e2d6-4044-4a67-9d54-d3927b72b78f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172812 Nov 19 20:15:58.401338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2191/4345] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:58 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:15:59.054357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-11355b02-2187-4b8d-8bb5-09d38ac81b44 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d08b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:59.102320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-11355b02-2187-4b8d-8bb5-09d38ac81b44 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052115 Nov 19 20:15:59.102907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2155/4346] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:15:59 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:15:59.418163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:15:59.418730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:15:59.425444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:59.425888 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:59.426694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:15:59.427122 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:15:59.578433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:15:59.591589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-79170991-8bdc-403f-aecf-6bef5634b4fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177011 Nov 19 20:15:59.592231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2192/4347] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:15:59 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:00.117282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f56fd14b-ef70-426d-b348-804acb7a34d8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:00.169074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f56fd14b-ef70-426d-b348-804acb7a34d8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057348 Nov 19 20:16:00.169783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2156/4348] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:00 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:00.612569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:00.613151 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:00.620191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:00.620645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:00.621417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:00.621922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:00.788742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:00.801103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2aac2771-b4b2-4255-94db-f4a2d60d2e82 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.193533 Nov 19 20:16:00.801907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2193/4349] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:00 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:01.184112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be30a5df-25a5-499f-97ff-6e3b575e5045 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:01.238948 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be30a5df-25a5-499f-97ff-6e3b575e5045 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060984 Nov 19 20:16:01.239518 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2157/4350] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:01 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:01.826126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:01.826760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:01.835605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:01.836227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:01.837722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:01.838420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:01.982014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:01.992172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-37711fb9-05d4-4d32-8a7b-b516858ca16e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170986 Nov 19 20:16:01.992938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2194/4351] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:01 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:02.251863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dd95b3b0-f3c9-47b9-a80a-ad01a3da731e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6550>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:02.298763 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dd95b3b0-f3c9-47b9-a80a-ad01a3da731e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050925 Nov 19 20:16:02.299550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2158/4352] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:02 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:03.016822 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:03.017442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:03.027615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:03.028225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:03.029319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:03.029847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:03.163357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:03.171326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c8559cf5-33d4-448e-88ab-dd5163bf19d0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.159756 Nov 19 20:16:03.171896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2195/4353] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:03 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:03.315590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2cfdeec8-e537-4078-a821-c848d8c9f17d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:03.365259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2cfdeec8-e537-4078-a821-c848d8c9f17d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055644 Nov 19 20:16:03.366213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2159/4354] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:03 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:04.188614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:04.189215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:04.196696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:04.197134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:04.197899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:04.198363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:04.355150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:04.364141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1d279a1f-08ce-47c2-8c3d-d428bc08d4e5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179204 Nov 19 20:16:04.364692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2196/4355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:04 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:04.382935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4c39d0f0-0d7b-415d-bea7-0ea34aa1d487 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:04.438970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4c39d0f0-0d7b-415d-bea7-0ea34aa1d487 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062698 Nov 19 20:16:04.439521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2160/4356] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:04 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:04.505590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:16:04.505802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:16:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:16:05.381827 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:05.382813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:05.390555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:05.391157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:05.392294 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:05.392752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:05.452426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-05a9c33e-d712-450c-a106-e21393b04e5e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:05.499053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-05a9c33e-d712-450c-a106-e21393b04e5e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050749 Nov 19 20:16:05.505212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2161/4357] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:05 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:05.539760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:05.547704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-90b0b3fe-35ad-4874-b267-5f6fc29314ee tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169562 Nov 19 20:16:05.548362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2197/4358] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:05 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:16:06.514651 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b00b0735-8f4e-41c2-a8bb-0e4c584eb4bb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30e50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:06.564579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:06.565649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:06.566091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b00b0735-8f4e-41c2-a8bb-0e4c584eb4bb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057385 Nov 19 20:16:06.567270 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2162/4359] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:06 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:06.572373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:06.572813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:06.573581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:06.574008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:06.714322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:06.726533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4bb982a4-b4da-4d0e-8a2b-bf6a7966d199 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165295 Nov 19 20:16:06.727358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2198/4360] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:06 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:07.583454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e2a0e0c1-66df-49d4-9225-6a8c97372380 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849f310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:07.637422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e2a0e0c1-66df-49d4-9225-6a8c97372380 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060788 Nov 19 20:16:07.637991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2163/4361] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:07 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:07.746236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:07.746913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:07.753094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:07.753511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:07.754305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:07.754736 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:07.886835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:07.895259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d0461e20-f0cb-42e1-b027-0213d0cb9e62 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.152727 Nov 19 20:16:07.895825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2199/4362] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:07 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:08.650600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46ca1114-f623-4b0f-8413-e8f7e29cb80b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:08.700794 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46ca1114-f623-4b0f-8413-e8f7e29cb80b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054287 Nov 19 20:16:08.701450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2164/4363] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:08 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:08.914776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:08.915342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:08.923197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:08.923649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:08.924788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:08.925370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:09.077161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:09.086593 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-57ddd908-582f-459a-9e9a-b4cd53a095e9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177181 Nov 19 20:16:09.087633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2200/4364] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:08 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:09.717247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8fe34919-95cf-4413-a8c3-1462f84e3d20 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:09.767855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8fe34919-95cf-4413-a8c3-1462f84e3d20 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057027 Nov 19 20:16:09.768423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2165/4365] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:09 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:10.108490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:10.109101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:10.115832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:10.116285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:10.117059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:10.117488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:10.254728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:10.267388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d0c33fb-b66e-49ea-a74d-8b3874e9fb05 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162264 Nov 19 20:16:10.268334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2201/4366] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:10 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:10.781586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-946d1fd1-ca7e-4bc0-b759-c10c7e70f1ee tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe64c0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:10.830452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-946d1fd1-ca7e-4bc0-b759-c10c7e70f1ee tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052930 Nov 19 20:16:10.831045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2166/4367] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:10 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:11.285127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:11.285737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:11.292941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:11.293390 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:11.294186 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:11.294613 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:11.452101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:11.461456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb19e3a1-5f4c-4378-baaa-64a78a4287d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.180364 Nov 19 20:16:11.462017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2202/4368] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:11 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:11.846441 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-808e7ed6-aa5f-4d63-a9f2-b09fad2d31dd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:11.895324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-808e7ed6-aa5f-4d63-a9f2-b09fad2d31dd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055055 Nov 19 20:16:11.895915 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2167/4369] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:11 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:12.478913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:12.479456 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:12.486254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:12.486700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:12.487457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:12.488448 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:12.630253 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:12.642109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dec11cee-f2d8-4110-9ec6-e02aaadaad0c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166729 Nov 19 20:16:12.643040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2203/4370] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:12 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:12.909050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9f5b9a99-3100-4e43-b021-929642409643 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:12.956448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9f5b9a99-3100-4e43-b021-929642409643 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051532 Nov 19 20:16:12.957382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2168/4371] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:12 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:13.664481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:13.665387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:13.675094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:13.676219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:13.676698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:13.677126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:13.819836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:13.832569 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7dcfa4c4-d627-482b-ae4e-0aa3c163829e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171658 Nov 19 20:16:13.833126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2204/4372] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:13 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:13.972247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b2e5e190-562d-4da8-8304-1dc65899e0a4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849ff70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:14.031405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b2e5e190-562d-4da8-8304-1dc65899e0a4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.065306 Nov 19 20:16:14.032627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2169/4373] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:13 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:14.851958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:14.852574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:14.862357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:14.863085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:14.864339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:14.864957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:15.031329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:15.041293 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f5acd293-28bd-4acd-a75b-d4fd6e2140d3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.193583 Nov 19 20:16:15.041899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2205/4374] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:15.045958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-afdc7f06-484a-4b55-932a-bd664e7c58a9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832fa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:15.101581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-afdc7f06-484a-4b55-932a-bd664e7c58a9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060370 Nov 19 20:16:15.102240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2170/4375] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:15 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:16.061007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:16.061609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:16.070886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:16.071401 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:16.072549 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:16.073327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:16.117762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef3eb7df-fb5d-4d9c-8fbc-6dab7b9322a6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdce50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:16.166846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef3eb7df-fb5d-4d9c-8fbc-6dab7b9322a6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055698 Nov 19 20:16:16.167938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2171/4376] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:16 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:16.220922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:16.229285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-85816c11-0808-4d38-bc16-1af07bd22ce1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173486 Nov 19 20:16:16.229853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2206/4377] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:16 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:17.181750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8419ba09-d7b8-49d4-b032-82d8bcbcee62 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1482d0d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:17.231857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8419ba09-d7b8-49d4-b032-82d8bcbcee62 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054454 Nov 19 20:16:17.232833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2172/4378] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:17 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:17.247646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:17.248592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:17.254664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:17.255113 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:17.255938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:17.256370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:17.418766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:17.427209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9280c520-7609-44e0-bddd-f4fff131ac64 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.183345 Nov 19 20:16:17.427809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2207/4379] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:17 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:18.248228 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3fcadef9-39df-425a-8fa0-58e3aba07af0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30af0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:18.296796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3fcadef9-39df-425a-8fa0-58e3aba07af0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055222 Nov 19 20:16:18.297337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2173/4380] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:18 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:18.447678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:18.448271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:18.455247 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:18.455688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:18.456457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:18.456886 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:18.597411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:18.609218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dee1bcab-04ab-4742-be2d-c2875990673b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165348 Nov 19 20:16:18.610093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2208/4381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:18 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:19.312239 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f77a6abc-71b6-4efc-a3eb-27f9faf128d8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:19.371122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f77a6abc-71b6-4efc-a3eb-27f9faf128d8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.064595 Nov 19 20:16:19.371122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2174/4382] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:19 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:19.629362 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:19.629911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:19.636445 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:19.636881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:19.637643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:19.638079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:19.790250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:19.798654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ceba1b43-000a-4535-8e69-683ec4e5e569 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173330 Nov 19 20:16:19.799225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2209/4383] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:20.383797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59aadbb7-df11-4582-879a-2b782eb0a729 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849fee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:20.442420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59aadbb7-df11-4582-879a-2b782eb0a729 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062768 Nov 19 20:16:20.443000 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2175/4384] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:20 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:20.816801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:20.817477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:20.824494 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:20.824926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:20.825704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:20.826179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:20.970135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:20.978462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-964243c4-adb2-4d7a-9224-3f00411505ed tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165624 Nov 19 20:16:20.979032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2210/4385] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:20 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:21.456497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-60b8c0c3-f202-440a-b9c8-8db5470c8c76 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832fd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:21.506496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-60b8c0c3-f202-440a-b9c8-8db5470c8c76 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054072 Nov 19 20:16:21.507158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2176/4386] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:21 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:21.996669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:21.997328 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:22.004085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:22.004537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:22.005332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:22.005769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:22.146625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:22.155275 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-70c897fd-20bf-4c4e-9d31-fe99e9772059 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162984 Nov 19 20:16:22.155858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2211/4387] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:22.520236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5040ca54-54f6-48e9-b627-bba356c71286 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:22.574585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5040ca54-54f6-48e9-b627-bba356c71286 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058408 Nov 19 20:16:22.575247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2177/4388] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:22 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:23.172465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:23.173108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:23.179573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:23.180161 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:23.180971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:23.181396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:23.338199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:23.346587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b74b6dc9-a7de-4bad-abe7-59a06831a0fa tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177798 Nov 19 20:16:23.347152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2212/4389] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:23 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:23.590603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-77799918-9806-4955-9be0-2454f28e0d59 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f9d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:23.645805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-77799918-9806-4955-9be0-2454f28e0d59 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061890 Nov 19 20:16:23.646449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2178/4390] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:23 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:24.366334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:24.366908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:24.373891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:24.374370 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:24.375150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:24.375586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:24.519471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:24.527969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-49926f02-e159-480b-8093-5a73f4729cff tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165823 Nov 19 20:16:24.528533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2213/4391] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:24 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:24.659300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ae0ed7e4-c0d7-4419-8309-ef2b8dcfea1f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849ff70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:24.710992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ae0ed7e4-c0d7-4419-8309-ef2b8dcfea1f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055703 Nov 19 20:16:24.711643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2179/4392] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:24 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:25.546232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:25.546814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:25.553564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:25.554011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:25.554843 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:25.555280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:25.702553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:25.710830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-287e9bfd-a122-4cf0-b7d4-44379f3ebecb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168742 Nov 19 20:16:25.711407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2214/4393] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:25 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:25.725645 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a479d04e-d698-4928-aa5b-e55765722621 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:25.775861 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a479d04e-d698-4928-aa5b-e55765722621 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055850 Nov 19 20:16:25.776406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2180/4394] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:25 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:26.729643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:26.730524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:26.737373 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:26.737790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:26.738605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:26.739023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:26.788621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-455050a6-9200-40ff-9a36-9983207baac1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:26.837918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-455050a6-9200-40ff-9a36-9983207baac1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052994 Nov 19 20:16:26.838673 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2181/4395] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:26 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:26.903539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:26.913131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f6f9f737-c003-4b94-affb-8bb2f0125f21 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.187166 Nov 19 20:16:26.913742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2215/4396] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:26 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:27.850672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f1041dfc-1589-4a96-bb55-93491d9c3c23 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca40820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:27.899603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f1041dfc-1589-4a96-bb55-93491d9c3c23 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052582 Nov 19 20:16:27.899906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2182/4397] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:27 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:27.932508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:27.934433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:27.949764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:27.949764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:27.949764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:27.949764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:28.147962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:28.162817 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-20dd1505-c407-4451-b180-b157b416c747 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.235226 Nov 19 20:16:28.163707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2216/4398] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:28.915042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-41c04b2e-7551-4a03-bfbf-354b34eaf898 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59e50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:28.969493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-41c04b2e-7551-4a03-bfbf-354b34eaf898 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058627 Nov 19 20:16:28.970320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2183/4399] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:28 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:29.181053 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:29.181609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:29.188498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:29.188942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:29.189707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:29.190162 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:29.347915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:29.359415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3736528f-63ca-4d90-9995-e065da69b17a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181802 Nov 19 20:16:29.360536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2217/4400] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:29 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:29.985084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1cca750f-771e-419f-afe4-cb1a98ae2dae tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcdc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:30.038749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1cca750f-771e-419f-afe4-cb1a98ae2dae tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057763 Nov 19 20:16:30.039315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2184/4401] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:29 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:30.378555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:30.379245 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:30.385926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:30.386466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:30.387244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:30.387676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:30.547815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:30.556256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a328e9b8-08ee-426a-9a3f-27476f9b88b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181381 Nov 19 20:16:30.556805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2218/4402] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:30 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:31.053395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-63f6401b-94d8-490a-8756-955de010096a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:31.106603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-63f6401b-94d8-490a-8756-955de010096a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058106 Nov 19 20:16:31.107188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2185/4403] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:31 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:31.577980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:31.578690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:31.585313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:31.585787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:31.586601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:31.587025 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:31.723747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:31.733094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-de564aa5-2cdc-47f3-8f95-d7890a096bac tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.159899 Nov 19 20:16:31.733677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2219/4404] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:31 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:32.119903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-31822bee-dbf5-4ba1-bb61-052f36629f7b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:32.169797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-31822bee-dbf5-4ba1-bb61-052f36629f7b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053923 Nov 19 20:16:32.170490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2186/4405] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:32 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:32.750737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:32.751357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:32.757942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:32.758393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:32.759171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:32.759595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:32.915246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:32.923724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-624b8fbe-8e60-4240-8d5c-6b4daf8866b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176768 Nov 19 20:16:32.924287 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2220/4406] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:32 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:33.183127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-76833e40-7e73-438e-b738-230a504589ed tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832fa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:33.233311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-76833e40-7e73-438e-b738-230a504589ed tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054414 Nov 19 20:16:33.233884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2187/4407] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:33 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:33.940981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:33.941630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:33.949393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:33.949826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:33.950651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:33.951098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:34.102396 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:34.110778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5934d01d-9f02-419a-984e-f5b1334348a3 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173536 Nov 19 20:16:34.111358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2221/4408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:33 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:34.246565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7ede037b-d356-43ef-b229-a8fff1375211 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:34.298760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7ede037b-d356-43ef-b229-a8fff1375211 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055930 Nov 19 20:16:34.299580 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2188/4409] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:34 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:35.128598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:35.129221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:35.136987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:35.137441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:35.138270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:35.138706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:35.314616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:35.316600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7c58240-eafa-41a7-b3e4-75dfd80fac6f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:35.328982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ce2bc77-e0f5-49cd-9106-3bf7fdffd4ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.203778 Nov 19 20:16:35.330605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2222/4410] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:35 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:35.383131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7c58240-eafa-41a7-b3e4-75dfd80fac6f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.073348 Nov 19 20:16:35.384409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2189/4411] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:35 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:36.349077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:36.349745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:36.357056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:36.357527 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:36.358340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:36.358778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:36.398190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-57abb79b-1cdb-4328-957f-031f98ff3f0c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:36.456639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-57abb79b-1cdb-4328-957f-031f98ff3f0c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062127 Nov 19 20:16:36.457707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2190/4412] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:36 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:16:36.515597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:36.524337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af9ec5a0-da25-4f4f-b6e5-8a54366a2c22 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178931 Nov 19 20:16:36.524936 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2223/4413] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:36 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:37.471321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-444dc291-f16b-4ce4-b413-579c354b257b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caabaf0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:37.525752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-444dc291-f16b-4ce4-b413-579c354b257b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058897 Nov 19 20:16:37.526548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2191/4414] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:37 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:37.549130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:37.549757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:37.556295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:37.556749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:37.557552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:37.558289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:37.704833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:37.713646 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7a15af3d-44bb-4f8f-9a26-88543bf26a16 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168423 Nov 19 20:16:37.714332 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2224/4415] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:37 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:38.539986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1c447e20-bb40-4095-91da-2147537779d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30af0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:38.598517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1c447e20-bb40-4095-91da-2147537779d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062008 Nov 19 20:16:38.599615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2192/4416] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:38 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:38.731047 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:38.732380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:38.739765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:38.740208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:38.740998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:38.741469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:38.891907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:38.901115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f2f6baa3-eafc-4904-b071-607f8a9c19bb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173684 Nov 19 20:16:38.902713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2225/4417] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:38 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:39.615066 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c84c5b4f-c4fb-469a-9c67-978b21dafac5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:39.685572 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c84c5b4f-c4fb-469a-9c67-978b21dafac5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.074620 Nov 19 20:16:39.686303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2193/4418] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:39 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:39.919677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:39.920252 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:39.927654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:39.928110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:39.928919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:39.929360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:40.073474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:40.082152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-80fe2a6e-49e9-43e2-aefa-4f82d0e56794 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166505 Nov 19 20:16:40.082741 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2226/4419] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:39 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:40.701637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-33f6a7d6-e773-453c-9eeb-e3200d88a472 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcf70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:40.752184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-33f6a7d6-e773-453c-9eeb-e3200d88a472 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055221 Nov 19 20:16:40.753058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2194/4420] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:40 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:41.101383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:41.102022 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:41.109000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:41.109451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:41.110260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:41.110691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:41.256123 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:41.264461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-50599575-fba0-4fc4-9399-3878594dcb19 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167316 Nov 19 20:16:41.265026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2227/4421] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:41 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:41.771136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa356f75-7fdc-4b0a-9611-e360d618aaf7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb303a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:41.823843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa356f75-7fdc-4b0a-9611-e360d618aaf7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058728 Nov 19 20:16:41.824579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2195/4422] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:41 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:42.282133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:42.282834 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:42.289464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:42.289912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:42.290716 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:42.291150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:42.448422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:42.461597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1ee6b896-77b8-4b77-9ef4-8b794d31f6fb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.183197 Nov 19 20:16:42.462801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2228/4423] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:42 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:42.838347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e4a7830e-ce46-4e1e-ad1b-16adc220465d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc0d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:42.884635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e4a7830e-ce46-4e1e-ad1b-16adc220465d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050877 Nov 19 20:16:42.885256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2196/4424] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:42 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:43.480985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:43.482138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:43.488852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:43.489313 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:43.490156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:43.490582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:43.630730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:43.639902 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-05384c6b-385a-43e7-84c2-71477e1514f9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162687 Nov 19 20:16:43.640693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2229/4425] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:43 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:43.898317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-96c4a097-b3a2-4439-91a5-57747b9c651c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:43.948135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-96c4a097-b3a2-4439-91a5-57747b9c651c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053956 Nov 19 20:16:43.948712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2197/4426] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:43 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:44.657633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:44.658493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:44.665218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:44.665659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:44.666449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:44.666885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:44.819460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:44.833582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f021678d-1faf-4adf-a479-607f7d465215 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.179472 Nov 19 20:16:44.834582 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2230/4427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:44 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:44.961477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ed590c48-de9e-40ef-88f2-5791033637e8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada9d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:45.021132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ed590c48-de9e-40ef-88f2-5791033637e8 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.063867 Nov 19 20:16:45.021672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2198/4428] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:44 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:45.855673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:45.856350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:45.864165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:45.864608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:45.865490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:45.865898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:46.006344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:46.014726 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ba1fd65-b4a2-4304-8659-0ada815271be tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163047 Nov 19 20:16:46.015286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2231/4429] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:45 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:46.033785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-94f4e7f0-9133-48ff-bd63-9e14ceda44ef tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832fd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:46.085427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-94f4e7f0-9133-48ff-bd63-9e14ceda44ef tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055726 Nov 19 20:16:46.086075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2199/4430] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:46 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:16:47.032314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:47.032931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:47.039858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:47.040305 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:47.041109 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:47.041559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:47.099321 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e5e9a96e-d5ad-431f-ae9e-12febd0be7b1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:47.154986 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e5e9a96e-d5ad-431f-ae9e-12febd0be7b1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059659 Nov 19 20:16:47.160581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2200/4431] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:47 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:47.191788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:47.199932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8527506c-9487-4600-b796-5063d76cf026 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171448 Nov 19 20:16:47.206357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2232/4432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:47 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:48.168323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1057c2e2-845b-47bf-bbf6-b46cd4b14dc2 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:48.217177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:48.217824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:48.223987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:48.224336 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:48.225110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:48.225531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:48.226413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1057c2e2-845b-47bf-bbf6-b46cd4b14dc2 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062238 Nov 19 20:16:48.227122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2201/4433] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:48 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:48.382382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:48.391189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-77d46275-0fe4-4d2c-846c-8fe5fa6310bd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177891 Nov 19 20:16:48.391772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2233/4434] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:48 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:16:49.240483 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-513ca005-45ee-4966-a53a-f7cc72b2960d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6550>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:49.297063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-513ca005-45ee-4966-a53a-f7cc72b2960d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061096 Nov 19 20:16:49.302425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2202/4435] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:49 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:49.409118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:49.410298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:49.420154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:49.420769 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:49.421731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:49.422440 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:49.578202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:49.586706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-487c0908-d4b2-4172-afba-bd2aa4323aec tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181802 Nov 19 20:16:49.587286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2234/4436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:49 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:50.310685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4a34cb77-4adb-4d90-8555-9ed873fc50d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:50.363269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4a34cb77-4adb-4d90-8555-9ed873fc50d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056828 Nov 19 20:16:50.363848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2203/4437] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:50.613502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:50.614141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:50.620480 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:50.620930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:50.621732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:50.622138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:50.768950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:50.777578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9d16cc09-8d43-4533-89ea-7e653fc045c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176669 Nov 19 20:16:50.778134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2235/4438] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:50 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:51.380156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1675d55f-4a3d-4c73-8566-127fca2cdf91 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:51.439687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1675d55f-4a3d-4c73-8566-127fca2cdf91 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.066114 Nov 19 20:16:51.440519 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2204/4439] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:51 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:51.795829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:51.796511 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:51.803757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:51.804233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:51.805043 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:51.805513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:51.951209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:51.959993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9ba06f3d-275e-497c-be8c-f06b971fecdb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168278 Nov 19 20:16:51.960563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2236/4440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:51 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:52.458957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a737279c-bd44-45df-908e-105d6c8bdb25 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd160>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:52.514765 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a737279c-bd44-45df-908e-105d6c8bdb25 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062017 Nov 19 20:16:52.515639 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2205/4441] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:52.977114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:52.977670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:52.984701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:52.985149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:52.985920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:52.986382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:53.145135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:53.153806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e1953860-ce60-4032-829c-3de66ac6fdc8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.180736 Nov 19 20:16:53.154416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2237/4442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:52 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:53.528714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b86d92c7-1e1e-40df-924b-4367339c2690 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6a60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:53.582485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b86d92c7-1e1e-40df-924b-4367339c2690 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057621 Nov 19 20:16:53.583262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2206/4443] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:53 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:54.177638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:54.178238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:54.185133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:54.185687 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:54.186578 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:54.187004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:54.337116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:54.346237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f90a3999-f165-4423-ab18-69a5c5ea48de tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172399 Nov 19 20:16:54.346840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2238/4444] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:54 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:54.599751 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-38023bb3-6851-4969-bcc9-80be483107dd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c8b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:54.648164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-38023bb3-6851-4969-bcc9-80be483107dd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052570 Nov 19 20:16:54.648747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2207/4445] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:54 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:55.365983 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:55.366610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:55.373915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:55.374478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:55.375599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:55.376209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:55.530019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:55.538928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4443d6c7-100a-4834-af06-3bf347529629 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176687 Nov 19 20:16:55.539516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2239/4446] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:55 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:55.664090 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7cee6623-bd6f-49a4-a0d1-3f306d1779e7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb329d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:55.710097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7cee6623-bd6f-49a4-a0d1-3f306d1779e7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050027 Nov 19 20:16:55.710676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2208/4447] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:55 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:56.559311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:56.559954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:56.567081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:56.567529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:56.568368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:56.568801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:56.709808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:56.719026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee1ace61-b2be-41a7-aeb1-dac0c2bfb732 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164049 Nov 19 20:16:56.719571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2240/4448] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:56 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:56.723614 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c74cfa74-25df-4a6e-9b5c-25410030e87b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:56.776057 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c74cfa74-25df-4a6e-9b5c-25410030e87b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056688 Nov 19 20:16:56.776953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2209/4449] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:56 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:57.737334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:57.737917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:57.745068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:57.745507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:57.746314 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:57.746742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:57.794113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-53dd174b-469e-484d-b931-2ee55684a3fd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:57.842851 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-53dd174b-469e-484d-b931-2ee55684a3fd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055047 Nov 19 20:16:57.843429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2210/4450] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:57 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:57.887925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:57.896102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5663753d-32ac-47c2-8ace-967078c44070 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162522 Nov 19 20:16:57.896668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2241/4451] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:57 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:58.859118 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7ad7397-d33f-4e9b-a4a6-05547b22f880 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:58.915074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:58.915976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:16:58.923755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f7ad7397-d33f-4e9b-a4a6-05547b22f880 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.070846 Nov 19 20:16:58.924766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2211/4452] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:58 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:16:58.925281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:58.926104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:58.927248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:16:58.927790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:16:59.066181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:16:59.074688 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0e1b8af8-b39d-41c6-a0c7-62f3888f7d7e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165302 Nov 19 20:16:59.075319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2242/4453] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:16:58 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:16:59.939197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-766c8a5d-e28d-4f67-bc93-d02e67ebf5ba tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb328b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:16:59.988865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-766c8a5d-e28d-4f67-bc93-d02e67ebf5ba tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053778 Nov 19 20:16:59.989556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2212/4454] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:16:59 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:00.093028 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:00.093655 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:00.100420 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:00.100881 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:00.101647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:00.102119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:00.240874 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:00.253167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-98c345de-faaf-49e8-925d-1022ca25d8dd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163869 Nov 19 20:17:00.253927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2243/4455] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:00 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:01.005237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-045b6f09-bbe7-4f2a-a178-45d5abc7f67b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:01.060545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-045b6f09-bbe7-4f2a-a178-45d5abc7f67b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062005 Nov 19 20:17:01.061116 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2213/4456] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:00 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:01.278255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:01.279019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:01.287319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:01.287763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:01.288531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:01.288957 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:01.680391 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:01.691005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-03dac884-cf0a-433f-8b89-81caf9738185 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.417775 Nov 19 20:17:01.691561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2244/4457] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:01 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:17:02.076345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2e882128-84c6-4c3e-ba23-8304d2df3337 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca401f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:02.131160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2e882128-84c6-4c3e-ba23-8304d2df3337 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061273 Nov 19 20:17:02.131732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2214/4458] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:02 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:02.708363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:02.708977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:02.715991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:02.716427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:02.717195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:02.717618 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:02.866498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:02.878029 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-af6f228a-54b0-4e0f-8d6b-a09193808cdd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173401 Nov 19 20:17:02.878626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2245/4459] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:02 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:03.146257 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-46103b06-7456-484e-b86a-8a3f8c6e76e1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:03.196478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-46103b06-7456-484e-b86a-8a3f8c6e76e1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056862 Nov 19 20:17:03.197047 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2215/4460] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:03 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:03.899138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:03.899752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:03.908894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:03.909345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:03.910146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:03.910579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:04.063559 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:04.072595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d8786b4-c3ac-4d5a-ba11-b54660042f30 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.180006 Nov 19 20:17:04.073167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2246/4461] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:03 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:04.208944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e26f672b-8632-4d7d-913a-b4974b353192 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:04.268856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e26f672b-8632-4d7d-913a-b4974b353192 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.063968 Nov 19 20:17:04.269423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2216/4462] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:04 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:05.090387 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:05.091009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:05.097926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:05.098399 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:05.099176 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:05.099607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:05.261912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:05.271178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4347f4d3-c458-48f7-b899-a3c176b6d228 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.184807 Nov 19 20:17:05.271777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2247/4463] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:05 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:05.281215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b6562a5c-207e-4640-af2d-20e97f712cf5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb225e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:05.333147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b6562a5c-207e-4640-af2d-20e97f712cf5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056011 Nov 19 20:17:05.334482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2217/4464] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:05 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:06.289407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:06.290104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:06.297131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:06.297560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:06.298368 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:06.298802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:06.347152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-70deb4ca-2758-42e7-9e72-5f3ac669d268 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2cdc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:06.397053 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-70deb4ca-2758-42e7-9e72-5f3ac669d268 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053963 Nov 19 20:17:06.397593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2218/4465] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:06 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:06.440931 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:06.449686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-709cfded-632e-4729-bac2-bda648e6343e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164591 Nov 19 20:17:06.450322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2248/4466] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:06 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:07.409674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de1d0331-de92-4936-80dd-21671b6e3f9a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:07.462399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de1d0331-de92-4936-80dd-21671b6e3f9a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056764 Nov 19 20:17:07.463437 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2219/4467] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:07 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:07.467591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:07.468268 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:07.475201 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:07.475733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:07.476431 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:07.476946 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:07.621061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:07.632348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5f1710c-5039-4150-bb51-b55fd3b2d9d7 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168578 Nov 19 20:17:07.632959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2249/4468] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:07 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:08.476636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2ffc51d2-f681-4709-b79f-f6053204db58 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:08.530832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2ffc51d2-f681-4709-b79f-f6053204db58 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058969 Nov 19 20:17:08.531401 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2220/4469] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:08 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:08.648712 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:08.649319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:08.655887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:08.656334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:08.657102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:08.657540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:08.805422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:08.817002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8507e500-cf74-4330-9e85-bf901646f2d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171801 Nov 19 20:17:08.817628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2250/4470] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:08 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:09.546945 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b76b1723-cb24-4b0c-945d-881f2b07524e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:09.607820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b76b1723-cb24-4b0c-945d-881f2b07524e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.066021 Nov 19 20:17:09.607820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2221/4471] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:09 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:09.840507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:09.841042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:09.848194 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:09.848643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:09.849412 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:09.849847 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:10.003131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:10.011491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7932e0fd-dfe3-4e2c-8c95-fdaefc2eb9d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.175732 Nov 19 20:17:10.012073 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2251/4472] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:09 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:10.620444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-083c8117-7cc0-4e17-a419-8d9050f0a42b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:10.676834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-083c8117-7cc0-4e17-a419-8d9050f0a42b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060927 Nov 19 20:17:10.677414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2222/4473] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:10 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:11.035403 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:11.036007 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:11.045956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:11.046647 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:11.047732 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:11.048255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:11.191460 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:11.200380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8f6e994a-6790-459c-b769-7a978e841c3a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170623 Nov 19 20:17:11.200954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2252/4474] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:11 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:11.693237 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab4ff3f9-b649-425a-87a5-12611503c9ef tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb224c0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:11.754012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab4ff3f9-b649-425a-87a5-12611503c9ef tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.066943 Nov 19 20:17:11.754618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2223/4475] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:11 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:12.217227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:12.217932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:12.224685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:12.225129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:12.225910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:12.226452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:12.383254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:12.392269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f0a6d110-3c4d-4e5e-b7ec-68d694b9149e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178803 Nov 19 20:17:12.392857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2253/4476] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:12 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:12.771158 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-973bef37-5fed-4ae3-bb35-04dffbf51e4b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c160>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:12.822490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-973bef37-5fed-4ae3-bb35-04dffbf51e4b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057892 Nov 19 20:17:12.823264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2224/4477] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:12 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:13.411465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:13.412072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:13.421540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:13.422246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:13.423276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:13.423760 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:13.584690 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:13.593624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dd7c01bf-2a1d-4451-9ed1-66c6d23b15b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188121 Nov 19 20:17:13.594242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2254/4478] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:13 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:13.836018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-815a23b6-a616-40dd-a108-3154b56bad6c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:13.892067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-815a23b6-a616-40dd-a108-3154b56bad6c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060178 Nov 19 20:17:13.897232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2225/4479] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:13 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:14.618080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:14.618713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:14.625734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:14.626216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:14.626979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:14.627402 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:14.772600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:14.780875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-215aa41e-1e15-40d6-a20a-b8b07898e855 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168700 Nov 19 20:17:14.781442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2255/4480] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:14.905069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71471e90-ef8c-4c12-bcea-d0f13dfb9378 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:14.958112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71471e90-ef8c-4c12-bcea-d0f13dfb9378 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056853 Nov 19 20:17:14.958975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2226/4481] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:14 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:15.802985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:15.803703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:15.810491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:15.810941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:15.811710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:15.812138 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:15.958159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:15.966695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8c2cf373-9d1c-4d0a-b7f9-503f8150f1b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167415 Nov 19 20:17:15.967292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2256/4482] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:15 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:15.973032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-02ecfde5-849f-43fd-a013-8c1756e70a83 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:16.030203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-02ecfde5-849f-43fd-a013-8c1756e70a83 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061234 Nov 19 20:17:16.030781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2227/4483] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:15 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:16.985397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:16.986014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:16.993717 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:16.994355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:16.995133 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:16.995739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:17.044310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-88064bbb-d24b-46cc-ac18-5704a09517bd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cadaa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:17.093622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-88064bbb-d24b-46cc-ac18-5704a09517bd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054382 Nov 19 20:17:17.094731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2228/4484] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:17 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:17.139718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:17.151728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-067c9997-0323-465b-a849-72bcf34cfdbc tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170597 Nov 19 20:17:17.152300 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2257/4485] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:16 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:18.107056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4784b2ea-7ac5-4452-b5d2-16bf33d85666 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:18.153779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4784b2ea-7ac5-4452-b5d2-16bf33d85666 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051027 Nov 19 20:17:18.154885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2229/4486] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:18 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:18.169861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:18.170551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:18.177249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:18.177694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:18.178504 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:18.178942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:18.321984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:18.330543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-59108b5c-8b56-4f0c-847a-aacef6224cda tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165453 Nov 19 20:17:18.331114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2258/4487] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:18 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:19.167211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5d5d1fdd-2a08-4443-9908-3a4c5bdb9983 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:19.215675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5d5d1fdd-2a08-4443-9908-3a4c5bdb9983 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052534 Nov 19 20:17:19.216382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2230/4488] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:19 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:19.347625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:19.348249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:19.355009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:19.355470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:19.356248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:19.356668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:19.496174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:19.508395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1090a9fe-5cd2-4047-8302-a5b3d94d7939 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.164440 Nov 19 20:17:19.509481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2259/4489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:20.229192 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-129ad4eb-6578-476c-9c26-859a269b9fe3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30160>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:20.280291 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-129ad4eb-6578-476c-9c26-859a269b9fe3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055207 Nov 19 20:17:20.280858 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2231/4490] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:20 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:20.529262 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:20.529924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:20.537044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:20.537495 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:20.538333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:20.538771 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:20.681773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:20.690238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9d2ede4c-a4ed-4f7b-b69d-7d2f205621d6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167080 Nov 19 20:17:20.690848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2260/4491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:20 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:21.294086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a75d9a0-c844-4822-ae8b-d1a29c88cfa4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2ce50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:21.341346 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a75d9a0-c844-4822-ae8b-d1a29c88cfa4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051603 Nov 19 20:17:21.341952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2232/4492] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:21 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:21.707954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:21.708545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:21.715450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:21.715973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:21.716670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:21.717432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:21.864603 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:21.873134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a1a5684b-1f44-4753-993f-cac4a1a331d1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169440 Nov 19 20:17:21.873617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2261/4493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:22.354969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bab5e178-6923-49ce-89a0-a101cb66b11c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd160>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:22.405251 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bab5e178-6923-49ce-89a0-a101cb66b11c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054617 Nov 19 20:17:22.405822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2233/4494] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:22 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:22.893507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:22.894219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:22.902239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:22.902718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:22.903515 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:22.903943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:23.047801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:23.056097 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d8b8edcb-deb4-4c9b-ab14-3a36afb353a2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167866 Nov 19 20:17:23.056702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2262/4495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:22 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:23.417364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-24f76c84-5ca6-4dfa-bcd4-a028c72e0a39 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:23.470320 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-24f76c84-5ca6-4dfa-bcd4-a028c72e0a39 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057088 Nov 19 20:17:23.471783 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2234/4496] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:23 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:24.073046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:24.073611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:24.080354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:24.080804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:24.081605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:24.082069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:24.227685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:24.236141 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d62c0fae-223c-4a8d-b2a2-8fc3b7c9f26b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166888 Nov 19 20:17:24.236723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2263/4497] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:24 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:24.487912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89d5d12a-cb34-4d0e-91fe-e4219434f2fe tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca408b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:24.536854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89d5d12a-cb34-4d0e-91fe-e4219434f2fe tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053765 Nov 19 20:17:24.537421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2235/4498] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:24 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:25.254531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:25.255119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:25.261870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:25.262337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:25.263139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:25.263564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:25.403768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:25.413222 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be0d882b-7adc-4296-a794-675e5c7558ce tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162248 Nov 19 20:17:25.413699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2264/4499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:25 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:25.551063 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8c0c69a9-458b-4130-acd9-722cdccf8e82 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2cf70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:25.607891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8c0c69a9-458b-4130-acd9-722cdccf8e82 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061109 Nov 19 20:17:25.608525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2236/4500] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:25 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:26.431432 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:26.432208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:26.439637 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:26.440095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:26.440870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:26.441299 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:26.586553 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:26.596421 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8880197d-25c5-4ceb-9a9f-149c12a7529f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168680 Nov 19 20:17:26.596985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2265/4501] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:26 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:26.621159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-38bac815-8c2e-443e-9e5b-6dddd0f04182 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6e50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:26.670455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-38bac815-8c2e-443e-9e5b-6dddd0f04182 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053030 Nov 19 20:17:26.670791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2237/4502] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:26 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:27.615054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:27.615636 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:27.624592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:27.625044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:27.625849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:27.626337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:27.683374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0f645212-919f-448e-88b4-840053c70ae4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:27.733145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0f645212-919f-448e-88b4-840053c70ae4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053917 Nov 19 20:17:27.733903 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2238/4503] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:27 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:17:27.777106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:27.782681 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e271873d-1f7c-443d-967e-2d3e140dfa12 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171404 Nov 19 20:17:27.783248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2266/4504] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:28.746275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-612c4354-53b8-4613-a036-b3259c736588 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb228b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:28.794667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-612c4354-53b8-4613-a036-b3259c736588 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052712 Nov 19 20:17:28.799715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:28.800200 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:28.800474 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2239/4505] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:28 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:28.808472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:28.808750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:28.809534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:28.809998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:29.054137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:29.063731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-47e338a0-51e4-4402-ad8f-29d8b830a81c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.267541 Nov 19 20:17:29.068363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2267/4506] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:28 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:29.655173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:17:29.655466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:17:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:17:29.808093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3621b383-bbd7-4fc4-a572-f432055b41d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:29.855491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3621b383-bbd7-4fc4-a572-f432055b41d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051625 Nov 19 20:17:29.856081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2240/4507] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:29 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:30.080711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:30.081338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:30.089599 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:30.090085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:30.091163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:30.091325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:30.248308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:30.258751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-52bae4b2-3168-4009-a458-1f99618e0f26 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181651 Nov 19 20:17:30.259331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2268/4508] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:30 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:30.868743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1fe9647b-b9df-488a-80df-ccad4ee1530c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:30.917407 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1fe9647b-b9df-488a-80df-ccad4ee1530c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052688 Nov 19 20:17:30.917988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2241/4509] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:30 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:31.278967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:31.279777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:31.289250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:31.289908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:31.291335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:31.291784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:31.430840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:31.439885 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0b1f0b2e-a377-4d6f-bbaf-8f5abd83db8d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165558 Nov 19 20:17:31.440388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2269/4510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:31 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:31.931103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-836ec525-85c7-41e8-949f-c605d200efdb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42af0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:31.979072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-836ec525-85c7-41e8-949f-c605d200efdb tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051883 Nov 19 20:17:31.979766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2242/4511] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:31 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:32.456900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:32.457488 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:32.464340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:32.464780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:32.465622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:32.465971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:32.617924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:32.630224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ed7a42d9-f641-4307-b9d9-5d8d0d59df6f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.176750 Nov 19 20:17:32.630893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2270/4512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:32 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:32.992280 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ba818e9-668f-44e5-a3eb-afb34f115d7f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:33.046585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ba818e9-668f-44e5-a3eb-afb34f115d7f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058382 Nov 19 20:17:33.047145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2243/4513] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:32 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:33.651510 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:33.652082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:33.660958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:33.661544 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:33.662676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:33.663106 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:33.812673 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:33.821212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ca8404a-684d-4e50-8efb-a940023d6618 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.175929 Nov 19 20:17:33.821789 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2271/4514] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:33 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:34.060786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2cc867d3-00da-49c4-b9e1-14c476f06f76 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbdd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:34.107855 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2cc867d3-00da-49c4-b9e1-14c476f06f76 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051718 Nov 19 20:17:34.108447 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2244/4515] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:34 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:34.850372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:34.851000 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:34.858560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:34.859004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:34.859761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:34.860185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:35.000672 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:35.011868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-007abc9e-dbd1-4b11-8eff-8696a40106b6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167120 Nov 19 20:17:35.012452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2272/4516] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:34 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:17:35.121750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-186675c3-0cb8-46ee-b529-91fd1f46a69f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdce50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:35.175358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-186675c3-0cb8-46ee-b529-91fd1f46a69f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058677 Nov 19 20:17:35.175925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2245/4517] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:35 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:36.029156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:36.029794 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:36.038139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:36.038755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:36.040058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:36.040622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:36.189013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-acf6fb13-e197-416e-96bc-8cce998c2091 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:36.198573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:36.207325 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-601667fe-23e4-40d5-950b-32fcd81229b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.182211 Nov 19 20:17:36.208129 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2273/4518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:36 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:36.239503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-acf6fb13-e197-416e-96bc-8cce998c2091 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054521 Nov 19 20:17:36.240434 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2246/4519] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:36 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:37.225111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:37.225689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:37.234605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:37.235096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:37.235781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:37.236208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:37.253050 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fa665eec-4a0d-4fe9-848f-d69def1a66d2 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:37.315914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fa665eec-4a0d-4fe9-848f-d69def1a66d2 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.066935 Nov 19 20:17:37.316480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2247/4520] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:37 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:37.379486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:37.387929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f60c12c5-9d1f-4eb8-b6a0-ad072b63ee07 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166436 Nov 19 20:17:37.388508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2274/4521] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:37 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:38.328961 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d5f26c04-9d66-492f-95df-4b75b9bea07a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:38.386339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d5f26c04-9d66-492f-95df-4b75b9bea07a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061314 Nov 19 20:17:38.387074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2248/4522] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:38 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:38.404724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:38.405339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:38.412061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:38.412517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:38.413295 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:38.413728 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:38.573476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:38.581600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cefce29f-0d7f-4426-9d86-a32f98b6e4b8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.180564 Nov 19 20:17:38.582215 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2275/4523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:38 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:39.399748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3b217de2-ff84-4cbe-a173-40a7f503b006 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2c8b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:39.449624 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3b217de2-ff84-4cbe-a173-40a7f503b006 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053997 Nov 19 20:17:39.450208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2249/4524] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:39 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:39.599937 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:39.600568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:39.607439 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:39.607879 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:39.608658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:39.609085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:39.748017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:39.760198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-74fb99c7-75ff-4a20-9c64-5c14c4b2df77 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163606 Nov 19 20:17:39.760877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2276/4525] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:39 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:40.161706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:17:40.161706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:17:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:17:40.463385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-04a7bd2f-f4df-4c7c-a2ce-e8c1592d526d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:40.518249 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-04a7bd2f-f4df-4c7c-a2ce-e8c1592d526d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059454 Nov 19 20:17:40.518826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2250/4526] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:40 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:40.782251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:40.782856 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:40.790318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:40.790829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:40.792216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:40.792683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:40.937615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:40.946361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-28f9572a-fe35-43c1-8700-ea5f6cdad27e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168163 Nov 19 20:17:40.947051 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2277/4527] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:40 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:41.531583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e873e54a-8699-487b-ab45-4d75bc9585a5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc1f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:41.579264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e873e54a-8699-487b-ab45-4d75bc9585a5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051800 Nov 19 20:17:41.579835 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2251/4528] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:41 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:41.964326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:41.964979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:41.972232 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:41.972682 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:41.973538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:41.973967 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:42.118020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:42.126209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2bd1173b-0c78-4fc5-bcd1-22bf94ebd351 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166229 Nov 19 20:17:42.126775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2278/4529] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:41 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:42.593849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-41fe4faf-b89b-4392-9ff7-1ca152caf165 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb24940>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:42.644531 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-41fe4faf-b89b-4392-9ff7-1ca152caf165 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054782 Nov 19 20:17:42.645400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2252/4530] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:42 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:43.143465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:43.144094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:43.151996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:43.152263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:43.154426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:43.154426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:43.291985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:43.303182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef076c07-4276-4525-b91e-dff22e8ed68d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163435 Nov 19 20:17:43.303965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2279/4531] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:43 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:43.657197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b45ea2bd-4d6a-41ba-8289-2640f1fe7e6a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:43.717203 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b45ea2bd-4d6a-41ba-8289-2640f1fe7e6a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.064018 Nov 19 20:17:43.718034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2253/4532] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:43 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:44.325824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:44.326474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:44.333327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:44.333770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:44.334590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:44.335017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:44.477536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:44.487140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-70407f6c-0cce-441a-8cf6-31e3245c03b9 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165249 Nov 19 20:17:44.487710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2280/4533] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:44 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:44.731323 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-192d5e4d-66ee-4d73-8b12-d3a95163431c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:44.778511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-192d5e4d-66ee-4d73-8b12-d3a95163431c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051530 Nov 19 20:17:44.779297 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2254/4534] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:44 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:45.504633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:45.505259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:45.511981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:45.512430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:45.513197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:45.513625 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:45.663309 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:45.672451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-34796952-1fa9-440d-88a5-eafe2d3c8597 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171483 Nov 19 20:17:45.673030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2281/4535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:45 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:45.792070 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4df9f450-7603-48fb-9dca-bda3fc5c6b90 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849f310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:45.840202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4df9f450-7603-48fb-9dca-bda3fc5c6b90 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052247 Nov 19 20:17:45.840802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2255/4536] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:45 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:46.690628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:46.691264 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:46.697981 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:46.698459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:46.699224 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:46.699652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:46.853545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-df8ca28d-9025-4066-bf47-3f9e3cc6ff81 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb2ce50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:46.855598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:46.863876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-17fcb4b0-31d6-4c15-a88d-c6c0252456eb tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177054 Nov 19 20:17:46.864446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2282/4537] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:46 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:46.961616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-df8ca28d-9025-4066-bf47-3f9e3cc6ff81 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.112665 Nov 19 20:17:46.962229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2256/4538] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:46 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:47.882318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:47.882955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:47.889496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:47.889952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:47.890833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:47.891244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:47.974922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3fff0e40-0544-43cd-866f-66162512b171 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01f70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:48.025383 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3fff0e40-0544-43cd-866f-66162512b171 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054570 Nov 19 20:17:48.025968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2257/4539] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:47 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:48.087183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:48.097065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8fd6af4d-05d6-421e-89df-88e3b3b62ae6 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.218547 Nov 19 20:17:48.097691 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2283/4540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:47 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:49.040306 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c30a65bc-fe54-4236-86ca-b451aa1e5854 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbbd820>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:49.089984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c30a65bc-fe54-4236-86ca-b451aa1e5854 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053798 Nov 19 20:17:49.090609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2258/4541] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:49 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:49.114496 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:49.115234 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:49.121667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:49.122272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:49.123008 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:49.123632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:49.264240 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:49.272901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be5ac80a-a0b1-4f4c-a8a4-c64eaa9f9f3b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162520 Nov 19 20:17:49.273468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2284/4542] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:49 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:17:50.103395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ece9052-c2e7-46e4-80fb-9255501cb07f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:50.157144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ece9052-c2e7-46e4-80fb-9255501cb07f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057816 Nov 19 20:17:50.157769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2259/4543] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:50.290678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:50.291307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:50.298297 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:50.298747 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:50.299550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:50.300476 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:50.455621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:50.465093 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-92f5f796-937d-4ccb-b2ac-e7e6c688d84e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178024 Nov 19 20:17:50.465677 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2285/4544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:50 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:51.170273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-23b12bed-23e6-403c-ac3e-af928e9b0fa0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14849fee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:51.223161 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-23b12bed-23e6-403c-ac3e-af928e9b0fa0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056851 Nov 19 20:17:51.223799 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2260/4545] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:51 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:51.483461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:51.484190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:51.491092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:51.491805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:51.492560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:51.492990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:51.630567 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:51.642977 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-08ebdb91-bfbd-4d88-8846-9bd9f7819203 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163420 Nov 19 20:17:51.643750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2286/4546] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:51 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:52.236934 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cfc71212-a609-433b-9aae-1ace68099e4c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:52.285904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cfc71212-a609-433b-9aae-1ace68099e4c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053150 Nov 19 20:17:52.286533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2261/4547] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:52.661385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:52.662024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:52.669164 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:52.669604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:52.670407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:52.670812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:52.829914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:52.842587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-19d35ebd-7f3f-4824-9b3f-862eaa074302 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.184732 Nov 19 20:17:52.843404 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2287/4548] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:52 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:53.301952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ccf8dd6e-ea45-4d10-82e0-5be68dc213bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdc3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:53.353649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ccf8dd6e-ea45-4d10-82e0-5be68dc213bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055823 Nov 19 20:17:53.354335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2262/4549] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:53 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:53.870016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:53.870606 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:53.879949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:53.880570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:53.881788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:53.882260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:54.033155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:54.045472 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-676a8156-2899-4edc-af8b-20ecef7d1383 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.181589 Nov 19 20:17:54.046225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2288/4550] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:53 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:54.370537 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-62f1b3ec-7c5c-413f-b883-a0a265f0f297 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:54.418365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-62f1b3ec-7c5c-413f-b883-a0a265f0f297 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053131 Nov 19 20:17:54.418928 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2263/4551] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:54 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:55.067664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:55.068411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:55.076124 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:55.076623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:55.077521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:55.077994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:55.227331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:55.240037 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c396a787-5694-4ec1-851d-8d22480d9c93 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177868 Nov 19 20:17:55.240871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2289/4552] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:55 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:55.431408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-73d7fc7b-9080-4b3f-8f1e-b4deba6f0291 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:55.485650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-73d7fc7b-9080-4b3f-8f1e-b4deba6f0291 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058084 Nov 19 20:17:55.486612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2264/4553] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:55 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:56.262738 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:56.263969 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:56.272836 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:56.273319 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:56.274594 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:56.275034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:56.425850 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:56.439457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-411fbb0b-4cdb-4dbd-b74c-95cf891d056d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.182894 Nov 19 20:17:56.440204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2290/4554] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:56 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:56.500333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d203fd34-8bac-49e3-9755-5024e60e1a19 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:56.555108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d203fd34-8bac-49e3-9755-5024e60e1a19 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058966 Nov 19 20:17:56.555842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2265/4555] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:56 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:57.460868 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:57.461545 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:57.469394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:57.469840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:57.470644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:57.471078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:57.568145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c91765cc-9be0-4f4b-9a36-f30c14937557 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:57.615850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c91765cc-9be0-4f4b-9a36-f30c14937557 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051798 Nov 19 20:17:57.616415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2266/4556] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:57 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:57.618303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:57.626763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-71b1dca2-99d3-4cfd-83ea-3c4cb9de7c51 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171902 Nov 19 20:17:57.627330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2291/4557] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:57 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:58.632197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4759686e-6f84-45b6-9598-35805b408cd0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:58.643880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:58.644462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:58.651322 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:58.651853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:58.652601 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:58.653063 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:58.683890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4759686e-6f84-45b6-9598-35805b408cd0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057789 Nov 19 20:17:58.684494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2267/4558] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:58 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:58.794628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:58.802790 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8b3e03bc-320f-4709-ab0a-e87fe305818f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162573 Nov 19 20:17:58.803522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2292/4559] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:58 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:17:59.700067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1be6c162-6806-400e-9383-b9971569a149 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc148746c10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:59.750922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1be6c162-6806-400e-9383-b9971569a149 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056792 Nov 19 20:17:59.751502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2268/4560] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:17:59 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:17:59.819132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:17:59.819813 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:17:59.826591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:59.827036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:59.827875 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:17:59.828359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:17:59.963259 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:17:59.971867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e9d80a82-ff2e-45bc-9e21-991c55d0ab79 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.156284 Nov 19 20:17:59.972543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2293/4561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:17:59 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:00.764042 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7a3482bb-90bd-4b67-a7bc-987042d9a846 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:00.812062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7a3482bb-90bd-4b67-a7bc-987042d9a846 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052084 Nov 19 20:18:00.812620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2269/4562] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:00 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:00.988524 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:00.989135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:00.995500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:00.995951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:00.996792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:00.997143 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:01.141492 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:01.153468 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-14ef9ee8-1f2b-4c0b-85c1-9c966ebacfbe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168268 Nov 19 20:18:01.154393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2294/4563] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:00 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:01.827618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-949a9714-2c8d-4f6c-afb2-dae4d5f8e331 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb30ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:01.883890 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-949a9714-2c8d-4f6c-afb2-dae4d5f8e331 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.062441 Nov 19 20:18:01.884562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2270/4564] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:01 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:02.172564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:02.173130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:02.180080 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:02.180517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:02.181279 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:02.181703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:02.323801 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:02.332350 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-569228cb-f798-44c7-a095-5b1444162962 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163466 Nov 19 20:18:02.332810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2295/4565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:02 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:02.897776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b53d6e23-48d4-4045-af23-4c14a7cecca6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb25040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:02.943818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b53d6e23-48d4-4045-af23-4c14a7cecca6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050311 Nov 19 20:18:02.944365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2271/4566] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:02 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:03.349898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:03.350520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:03.357529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:03.358091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:03.358929 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:03.359357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:03.516635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:03.529662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee960042-5c58-45e5-bf55-0a0e48cd751d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.183315 Nov 19 20:18:03.530449 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2296/4567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:03 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:03.957563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5267cfc1-bf78-402e-bb0b-fbfc0b9129dc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59790>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:04.004450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5267cfc1-bf78-402e-bb0b-fbfc0b9129dc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.051175 Nov 19 20:18:04.005027 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2272/4568] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:03 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:04.548832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:04.549442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:04.556766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:04.557208 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:04.557970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:04.558486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:04.710839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:04.723238 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e2640184-345e-4375-b133-e6d48a18d1d2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178128 Nov 19 20:18:04.723812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2297/4569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:04 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:05.019195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-548adf97-6923-40fc-a4ee-298a8dec5593 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbdcd30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:05.069817 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-548adf97-6923-40fc-a4ee-298a8dec5593 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055580 Nov 19 20:18:05.070681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2273/4570] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:05 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:05.741107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:05.741774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:05.748548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:05.748994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:05.749770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:05.750239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:05.902776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:05.910701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8e438f4d-e64a-4a22-82ae-abf3e27a11b5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173894 Nov 19 20:18:05.911261 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2298/4571] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:05 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:06.083188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d2f5f809-c59e-4aff-a84b-6a62b47428f6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59310>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:06.129687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d2f5f809-c59e-4aff-a84b-6a62b47428f6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.050682 Nov 19 20:18:06.130315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2274/4572] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:06 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:06.932493 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:06.933085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:06.940135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:06.940707 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:06.941473 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:06.941907 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:07.091590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:07.101572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d2a5f0ae-d2ca-4896-befd-531c113c0946 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172778 Nov 19 20:18:07.102163 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2299/4573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:06 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:07.142077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-de084314-67a2-4989-8e74-11c46cc2a791 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb258b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:07.192790 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-de084314-67a2-4989-8e74-11c46cc2a791 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054705 Nov 19 20:18:07.193461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2275/4574] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:07 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:08.119378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:08.120014 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:08.126787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:08.127239 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:08.128013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:08.128733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:08.205153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0fedab97-0919-447b-825b-f6e14ab9d8b0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32af0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:08.257154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0fedab97-0919-447b-825b-f6e14ab9d8b0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056138 Nov 19 20:18:08.262200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2276/4575] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:08 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:18:08.279422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:08.287720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-33d33dba-f553-4ae7-a67b-d3a18b98bc3c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172053 Nov 19 20:18:08.288374 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2300/4576] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:08 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:09.269664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-112c2be0-5740-4bd1-aeac-9d78c2c0e509 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:09.304777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:09.305434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:09.312081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:09.312523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:09.313286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:09.313722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:09.317594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-112c2be0-5740-4bd1-aeac-9d78c2c0e509 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052118 Nov 19 20:18:09.318184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2277/4577] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:09 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:09.458772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:09.471054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-aa8f4159-8797-4de6-8a2e-5e2e32460a40 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169544 Nov 19 20:18:09.471912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2301/4578] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:09 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:10.330174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4f0d4c35-5242-4254-ac55-0ef4ae03b6bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01e50>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:10.386658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4f0d4c35-5242-4254-ac55-0ef4ae03b6bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060208 Nov 19 20:18:10.387467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2278/4579] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:10 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:10.488522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:10.489056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:10.495521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:10.495970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:10.496733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:10.497146 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:10.629126 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:10.641797 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-587d0b74-ae2d-4446-a693-ffc4666676a0 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.156828 Nov 19 20:18:10.642610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2302/4580] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:10 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:11.401244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9ae7c45b-df39-460a-a99b-7da44265b4bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc1485b4280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:11.450675 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9ae7c45b-df39-460a-a99b-7da44265b4bc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053430 Nov 19 20:18:11.451282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2279/4581] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:11 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:11.662409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:11.663019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:11.669873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:11.670347 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:11.671110 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:11.671542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:11.810152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:11.819592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c3d4ac16-cc95-40a2-b88e-28e68c55079f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.162267 Nov 19 20:18:11.820298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2303/4582] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:11 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:12.464214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-025688e6-da34-4e08-9fdb-00c3ee7bdbf7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01ee0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:12.512997 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-025688e6-da34-4e08-9fdb-00c3ee7bdbf7 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053110 Nov 19 20:18:12.513575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2280/4583] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:12 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:12.844635 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:12.845181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:12.855218 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:12.855781 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:12.856830 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:12.857372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:12.999335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:13.007896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3d471ab5-ace1-4c3f-8c54-bff611925ea5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.169008 Nov 19 20:18:13.008469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2304/4584] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:12 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:13.526370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4e21b6fe-c29a-4f89-98c1-3ba2592ae14e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada160>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:13.582206 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4e21b6fe-c29a-4f89-98c1-3ba2592ae14e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059961 Nov 19 20:18:13.582940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2281/4585] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:13 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:14.026265 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:14.026833 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:14.033859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:14.034466 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:14.035236 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:14.035689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:14.177776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:14.186444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-693176bf-477c-42cb-b474-1423f63a00af tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163912 Nov 19 20:18:14.187013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2305/4586] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:14 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:14.595719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5dcd08c1-19fd-4edc-b932-64565e1f6190 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb221f0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:14.647313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5dcd08c1-19fd-4edc-b932-64565e1f6190 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055622 Nov 19 20:18:14.648092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2282/4587] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:14 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:15.204207 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:15.204960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:15.213212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:15.213680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:15.214546 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:15.214984 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:15.369443 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:15.378099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b0931f13-6816-440b-a3b4-e820dbf51223 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.177889 Nov 19 20:18:15.378697 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2306/4588] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:15 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:15.660985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-737e754b-e8dc-4a67-ba46-e719e7a7cc2e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:15.710830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-737e754b-e8dc-4a67-ba46-e719e7a7cc2e tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054008 Nov 19 20:18:15.711853 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2283/4589] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:15 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:16.395905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:16.396563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:16.403196 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:16.403639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:16.404408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:16.404832 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:16.559131 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:16.570842 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46253461-d541-4a70-acb5-01c0a16c8290 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.178925 Nov 19 20:18:16.571570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2307/4590] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:16 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:16.725733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dbb9bead-62a1-4a6e-82d5-720498b0fcd6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:16.780421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dbb9bead-62a1-4a6e-82d5-720498b0fcd6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.059484 Nov 19 20:18:16.780988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2284/4591] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:16 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:17.588793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:17.589358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:17.596713 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:17.597175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:17.597960 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:17.598430 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:17.735863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:17.744949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-84afc31e-954d-4b59-ade8-2b13986385c8 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160173 Nov 19 20:18:17.745533 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2308/4592] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:17 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:17.793714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7e1ab5f8-aff1-432f-bc48-cbc3892dd653 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caabf70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:17.844678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7e1ab5f8-aff1-432f-bc48-cbc3892dd653 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055014 Nov 19 20:18:17.845240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2285/4593] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:17 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:18.762364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:18.762924 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:18.769804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:18.770301 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:18.771077 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:18.771514 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:18.858672 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bcbc4726-b222-4205-a74f-36f2c646663b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01550>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:18.907029 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bcbc4726-b222-4205-a74f-36f2c646663b tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052542 Nov 19 20:18:18.908145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2286/4594] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:18 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:18.923763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:18.932508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4b3dbd3e-a28e-4fe8-ad8c-9a964a9e5b5d tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173965 Nov 19 20:18:18.933075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2309/4595] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:18 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:19.920682 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c68dab7a-bbe8-4f46-9b82-507ddcf75d4c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cadaa60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:19.950074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:19.950639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:19.957965 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:19.958451 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:19.959349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:19.959756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:19.972480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c68dab7a-bbe8-4f46-9b82-507ddcf75d4c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.055819 Nov 19 20:18:19.981983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2287/4596] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:19 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:20.104484 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:20.113413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee047348-a815-4ce8-82fc-6b147c8f3b8e tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166858 Nov 19 20:18:20.114453 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2310/4597] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:19 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:20.992018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6c5c25de-d9fb-4851-a99c-58953558ee1f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb24430>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:21.045770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6c5c25de-d9fb-4851-a99c-58953558ee1f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.060196 Nov 19 20:18:21.046582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2288/4598] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:20 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:21.137475 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:21.138158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:21.145221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:21.145667 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:21.146479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:21.146900 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:21.298481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:21.307919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4842d5aa-300b-4ee2-b0b3-b2addc0fb678 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.173901 Nov 19 20:18:21.308507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2311/4599] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:21 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:22.060121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ab855fd7-04e4-4737-a484-245acc237e2d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01550>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:22.109059 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ab855fd7-04e4-4737-a484-245acc237e2d tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053082 Nov 19 20:18:22.110201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2289/4600] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:22 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:22.325042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:22.325627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:22.333101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:22.333548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:22.334361 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:22.334799 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:22.480660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:22.489796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-73cd976c-33a1-4a2d-9290-e2c6b341c2f1 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.168496 Nov 19 20:18:22.490407 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2312/4601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:22 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:23.121442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f39db2bb-16d4-4a25-8a7d-6be7c5d88ec5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab3a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:23.170241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f39db2bb-16d4-4a25-8a7d-6be7c5d88ec5 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052187 Nov 19 20:18:23.170805 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2290/4602] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:23 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:23.507349 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:23.507994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:23.515078 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:23.515530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:23.516486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:23.516916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:23.666429 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:23.675649 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b8b7862d-e4a3-4372-ae01-2e19837ddb08 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.171647 Nov 19 20:18:23.676255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2313/4603] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:23 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:24.189001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-054d110f-89d9-42b5-bd1a-91dff6af5f63 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:24.272606 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-054d110f-89d9-42b5-bd1a-91dff6af5f63 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.091602 Nov 19 20:18:24.273246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2291/4604] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:24 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:24.693611 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:24.694424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:24.704237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:24.704814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:24.706522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:24.707055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:24.850628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:24.859987 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-48f471f8-2cb5-4a0f-9c78-d6ac0bb621c5 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170704 Nov 19 20:18:24.861725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2314/4605] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:24 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:25.285303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-78270146-7535-4de3-acec-0f29dba8192c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22dc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:25.338388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-78270146-7535-4de3-acec-0f29dba8192c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056952 Nov 19 20:18:25.338971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2292/4606] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:25 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:25.879246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:25.879845 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:25.886775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:25.887225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:25.888015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:25.888446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:26.028811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:26.038589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3364f493-98f8-481e-90dd-1d637b36668b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.163267 Nov 19 20:18:26.039156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2315/4607] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:25 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:26.351432 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-740d3b36-2e24-4277-9425-5053e779e045 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb24a60>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:26.405840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-740d3b36-2e24-4277-9425-5053e779e045 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058416 Nov 19 20:18:26.406456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2293/4608] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:26 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:27.056344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:27.057030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:27.063864 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:27.064338 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:27.065181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:27.065854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:27.232103 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:27.241142 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-780d6dd1-130f-46d3-a86e-eff225540abe tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188457 Nov 19 20:18:27.241733 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2316/4609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:27 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:27.419759 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8344c643-6dae-46f2-b6f0-a3343e1acace tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cada700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:27.483565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8344c643-6dae-46f2-b6f0-a3343e1acace tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.068133 Nov 19 20:18:27.484106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2294/4610] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:27 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:28.259746 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:28.260623 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:28.267413 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:28.267855 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:28.269170 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:28.269680 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:28.430557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:28.444555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6b60c5b3-dfcf-4f29-bfbe-dc35cc6448fd tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.188946 Nov 19 20:18:28.445586 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2317/4611] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:28 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:28.496907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3aed9f71-c445-4b21-9aff-b42308b1df53 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb24af0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:28.550724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3aed9f71-c445-4b21-9aff-b42308b1df53 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057621 Nov 19 20:18:28.556647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2295/4612] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:28 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:29.462686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:29.463604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:29.470926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:29.471518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:29.472699 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:29.473175 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:29.564769 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1de16f1e-edec-43d8-acec-fa5ee8c3cc13 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb22ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:29.626810 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1de16f1e-edec-43d8-acec-fa5ee8c3cc13 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.066391 Nov 19 20:18:29.628221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2296/4613] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:29 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:18:29.645972 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:29.655406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-da5cdfea-4020-4e40-86f4-aed8456fa762 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.196179 Nov 19 20:18:29.656005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2318/4614] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:29 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:30.643220 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0c4c2fcd-0930-4387-9163-4d332f47cd27 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:30.674318 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:30.675223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:30.683532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:30.683979 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:30.684989 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:30.685592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:30.727593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0c4c2fcd-0930-4387-9163-4d332f47cd27 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.089669 Nov 19 20:18:30.728697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2297/4615] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:30 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:30.837705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:30.846269 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c9f401e0-d9cd-456f-ac10-63ababefddf2 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.175836 Nov 19 20:18:30.847589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2319/4616] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:30 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:18:31.741331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dc829d75-545f-4455-ada3-f0d58a1cb8a3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:31.790884 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dc829d75-545f-4455-ada3-f0d58a1cb8a3 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053775 Nov 19 20:18:31.791532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2298/4617] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:31 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:31.864411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:31.865221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:31.872139 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:31.872490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:31.873283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:31.873720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:32.048075 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:32.057859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8ebdc785-4f91-4fe5-a8c1-7e4af5405f92 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.197319 Nov 19 20:18:32.058505 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2320/4618] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:31 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:32.804482 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-064b893a-3eec-4cef-baa2-f96e2d474213 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb325e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:32.854232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-064b893a-3eec-4cef-baa2-f96e2d474213 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054596 Nov 19 20:18:32.854826 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2299/4619] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:32 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:33.086216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:33.086804 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:33.094074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:33.094531 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:33.095317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:33.095750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:33.244862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:33.255034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-031f63a3-56b8-4b75-adfa-800af545066b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172955 Nov 19 20:18:33.255630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2321/4620] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:33 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:33.870455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5493f0da-4a25-4f8c-a1b5-7dde037aecec tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb303a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:33.928011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5493f0da-4a25-4f8c-a1b5-7dde037aecec tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.061655 Nov 19 20:18:33.928594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2300/4621] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:33 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:34.272795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:34.273389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:34.280154 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:34.280598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:34.281358 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:34.281785 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:34.427221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:34.435128 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ede6f414-9932-4ac7-b4df-d7d40ac7044c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.166121 Nov 19 20:18:34.435694 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2322/4622] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:34 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:34.941937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b0b45e2a-48fd-4914-a6e0-e76a747459ca tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:34.994781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b0b45e2a-48fd-4914-a6e0-e76a747459ca tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057467 Nov 19 20:18:34.995499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2301/4623] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:34 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:35.452057 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:35.452683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:35.459479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:35.459927 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:35.460693 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:35.461125 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:35.604573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:35.613988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-46ed0fb1-79c9-427c-921a-e1b438c1ec78 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165397 Nov 19 20:18:35.614605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2323/4624] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:35 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:36.009658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1e97e061-4223-4f28-b71f-f70e66be3e9a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb24f70>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:36.062334 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1e97e061-4223-4f28-b71f-f70e66be3e9a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057981 Nov 19 20:18:36.063081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2302/4625] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:36 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:36.633009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:36.633598 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:36.643415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:36.643892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:36.644684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:36.645114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:36.791921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:36.800918 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3a26a0ee-3b0a-4415-825e-957418edf56b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172627 Nov 19 20:18:36.801512 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2324/4626] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:36 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:37.079411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6036da5d-4822-4ebc-8a2e-3055f008399a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb59700>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:37.131424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6036da5d-4822-4ebc-8a2e-3055f008399a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.058479 Nov 19 20:18:37.132005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2303/4627] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:37 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:37.818774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:37.819425 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:37.826837 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:37.827787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:37.828782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:37.829206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:37.975988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:37.984485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb737ee8-3ef6-4a85-94aa-b68d4ee7167f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.170278 Nov 19 20:18:37.985024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2325/4628] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:37 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:38.146468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d44c13b1-0f0d-4d83-ab82-e40894672388 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:38.197717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d44c13b1-0f0d-4d83-ab82-e40894672388 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.057107 Nov 19 20:18:38.198322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2304/4629] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:38 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:39.008889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:39.009588 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:39.016036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:39.016499 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:39.017263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:39.017695 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:39.159152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:39.170896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-eb8f4a44-1fec-48ff-9078-0e5f09a2cf1b tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.165826 Nov 19 20:18:39.171669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2326/4630] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:39 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:39.210812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cf6e3500-fa71-4b26-b2e5-f046a4617199 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:39.260405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cf6e3500-fa71-4b26-b2e5-f046a4617199 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053548 Nov 19 20:18:39.261096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2305/4631] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:39 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:18:40.188283 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:40.188913 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:40.197489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:40.197939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:40.198772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:40.199231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:40.277395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40d2719f-98ca-4816-8aa3-5fbe746ca9dd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb259d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:40.326275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40d2719f-98ca-4816-8aa3-5fbe746ca9dd tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056691 Nov 19 20:18:40.331768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2306/4632] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:40 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:40.357860 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:40.366980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-195b194f-5e71-403f-864f-c3cc46670232 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.182416 Nov 19 20:18:40.367627 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2327/4633] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:40 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:41.339896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7c60279d-213b-4a0c-95de-20366353e5b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb323a0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:41.384193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:41.384800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:41.388849 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7c60279d-213b-4a0c-95de-20366353e5b6 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053393 Nov 19 20:18:41.395199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:41.395199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:41.395199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:41.395199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:41.395842 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2307/4634] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:41 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:41.544560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:41.553220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ff5ec054-80ec-46ea-b2aa-d93472af0798 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.172662 Nov 19 20:18:41.553802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2328/4635] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:41 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:42.402846 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d728c334-c12b-42e5-96df-d63e7e669e69 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb01ca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:42.452205 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d728c334-c12b-42e5-96df-d63e7e669e69 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053476 Nov 19 20:18:42.452773 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2308/4636] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:42 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:42.570910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:42.572090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:42.579010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:42.579450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:42.580223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:42.580710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:42.726084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:42.734783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5d52287a-b8d1-472c-a389-dfa3c1e5b09a tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.167708 Nov 19 20:18:42.735394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2329/4637] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:42 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:43.465096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-86899faf-fccf-4a3a-a019-3797b6c39309 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe65e0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:43.514426 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-86899faf-fccf-4a3a-a019-3797b6c39309 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.053722 Nov 19 20:18:43.515019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2309/4638] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:43 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:43.753722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:43.754392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:43.761605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:43.761955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:43.762777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:43.763198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:43.901538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:43.910329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fba78d3a-96e2-4bcb-8a58-76e020c0a25f tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160686 Nov 19 20:18:43.910901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2330/4639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:43 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:44.529724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9fa5c031-726f-4ea8-a900-5822ec964439 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14caab8b0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:44.577800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9fa5c031-726f-4ea8-a900-5822ec964439 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.054331 Nov 19 20:18:44.578410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2310/4640] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:44 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:44.930489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:44.931036 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:44.937764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:44.938248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:44.939024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:44.939450 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:45.078816 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:45.087400 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7f493689-eb25-4d10-8fc3-632e8250180c tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.160734 Nov 19 20:18:45.088260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2331/4641] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:44 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:45.591219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7569afd4-8805-45a1-8082-0726d3096cbc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb32040>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:45.639123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7569afd4-8805-45a1-8082-0726d3096cbc tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.052372 Nov 19 20:18:45.639739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2311/4642] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:45 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:45.795905 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:45.796896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:45.803776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:45.804228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:45.805006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:45.805441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:45.836537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2701d891-c2aa-48f4-a48e-954e37d367f3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Nov 19 20:18:45.837091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2332/4643] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:18:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:45.903403 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:45.903897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:45.911038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:45.911489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:45.912260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:45.912687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:45.937856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 20:18:46.020331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-51e86d09-af52-4894-8377-1b32186a69f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 204 len: 0 microversion: 2.1 time: 0.120069 Nov 19 20:18:46.021075 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2312/4644] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:18:45 2021] DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 20:18:46.028911 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:46.029584 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:46.035974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:46.036416 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:46.037199 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:46.037628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:46.105191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:46.105778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:46.112069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:46.112487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:46.113374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:46.113797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:46.208865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:46.220282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5a9a91d3-a91d-457a-b1b1-b3dd4c45b6ab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1718 microversion: 2.1 time: 0.195179 Nov 19 20:18:46.220876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2333/4645] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1718 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:46.285600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:46.293550 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-59f76403-8195-4a22-bcdc-de02f2f51692 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.192514 Nov 19 20:18:46.294136 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2313/4646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:46 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:18:46.653887 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-75954a58-7f4a-45fa-9ceb-bf4401f0715a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb8fb80>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:46.705024 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-75954a58-7f4a-45fa-9ceb-bf4401f0715a tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.056545 Nov 19 20:18:46.705621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2334/4647] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:46 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:47.238456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:47.239108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:47.245924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:47.246579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:47.247386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:47.248097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:47.310914 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:47.311624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] [instance: d55b5c82-d731-4c63-aa4f-3ba1a695dee4] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:47.317942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:47.318435 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:47.319217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:47.319642 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:47.719818 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:47.727844 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d3462073007465e9154b15c23f8cddf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f61b72e190f44f579af38f0dd53b9677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:47.729045 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c7cbcc50-d6ef-4776-ade3-5a2916369e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1718 microversion: 2.1 time: 0.494061 Nov 19 20:18:47.739824 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2314/4648] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1718 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:47.744415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9cb1f58e-2f1c-41ef-ac21-c4dc4a372568 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cbe6670>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:47.746363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-944555ea-2365-4963-88a4-19fa50a95160 tempest-VolumesSnapshotTestJSON-807663851 tempest-VolumesSnapshotTestJSON-807663851-project] 10.222.0.46 "GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4" status: 200 len: 1561 microversion: 2.1 time: 0.439567 Nov 19 20:18:47.754214 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2335/4649] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:47 2021] GET /compute/v2.1/servers/d55b5c82-d731-4c63-aa4f-3ba1a695dee4 => generated 1561 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:47.841414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9cb1f58e-2f1c-41ef-ac21-c4dc4a372568 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.100464 Nov 19 20:18:47.841976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2315/4650] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:47 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:48.160108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-263d0efb-a119-4e62-9072-4e4febaddef9 req-e7542e06-3088-4683-8cf6-26fbb16e0dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9233030-c878-4eef-a231-13ba34eae0c2", "name": "network-vif-deleted", "tag": "098b2daa-b628-41ee-b4c2-112143fa0d32"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:18:48.161982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:18:48.161982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:18:48.173197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-263d0efb-a119-4e62-9072-4e4febaddef9 req-e7542e06-3088-4683-8cf6-26fbb16e0dc3 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:48.174410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-263d0efb-a119-4e62-9072-4e4febaddef9 req-e7542e06-3088-4683-8cf6-26fbb16e0dc3 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:48.190082 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-263d0efb-a119-4e62-9072-4e4febaddef9 req-e7542e06-3088-4683-8cf6-26fbb16e0dc3 service nova] Creating event network-vif-deleted:098b2daa-b628-41ee-b4c2-112143fa0d32 for instance e9233030-c878-4eef-a231-13ba34eae0c2 on hv-cinder-77703 Nov 19 20:18:48.198780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-263d0efb-a119-4e62-9072-4e4febaddef9 req-e7542e06-3088-4683-8cf6-26fbb16e0dc3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116394 Nov 19 20:18:48.200782 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2336/4651] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:18:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:18:48.747524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:48.748122 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:48.754709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:48.755149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:48.755967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:48.756400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:48.820972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:48.829058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-faea9a40-8b39-42cb-90e6-313c0ce86374 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085777 Nov 19 20:18:48.829615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2316/4652] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:48.854074 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3c3f1257-27b2-4427-9f77-0b9b93ba15b1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14c98f430>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:49.799876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3c3f1257-27b2-4427-9f77-0b9b93ba15b1 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.949979 Nov 19 20:18:49.800685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2337/4653] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:48 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:18:49.846502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:49.847170 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:49.853746 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:49.854244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:49.855026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:49.855458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:49.918349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:49.931787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-31622c2b-32b0-4d4b-a0eb-dc10e83dd839 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088577 Nov 19 20:18:49.932658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2317/4654] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:50.816537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e365112f-2cc9-4184-8588-69c00baf9e3f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc149921e50>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:50.952488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:50.953091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:50.960104 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:50.960520 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:50.961322 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:50.961754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:51.023182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:51.031503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a858e8f8-5302-4cc0-b1d2-056d2ed927f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.082785 Nov 19 20:18:51.032072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2318/4655] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:52.049165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:52.050108 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:52.057043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:52.057490 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:52.058288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:52.058718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:52.137683 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:52.148466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7a42eb8-441e-4ce0-83eb-c0134f9bf4d1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.103173 Nov 19 20:18:52.149266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2319/4656] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:53.167390 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:53.168132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:53.174815 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:53.175287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:53.176064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:53.176477 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:53.233031 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:18:53.233307 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:18:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 (ip 10.222.0.46) !!! Nov 19 20:18:53.247608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:53.258258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f78735cd-e70a-4117-89c1-aaf1b54abcb7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094518 Nov 19 20:18:53.258840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2320/4657] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:54.278494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:54.279184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:54.286340 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:54.286889 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:54.287802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:54.288207 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:54.354212 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:54.363088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f69d8134-f37c-4070-bcfc-e748e3dddc48 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087801 Nov 19 20:18:54.363932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2321/4658] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:18:55.388691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:55.389781 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:55.398028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:55.398511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:55.399282 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:55.399690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:55.468766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:55.481351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6adff1f7-1555-474f-bd9c-a3c8f4382923 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098230 Nov 19 20:18:55.482198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2322/4659] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:56.501144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:56.501859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:56.509011 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:56.509398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:56.510204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:56.510638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:56.575097 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:56.583558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-feea9057-71fd-4b79-987d-66e7f6765977 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086659 Nov 19 20:18:56.584093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2323/4660] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:18:56.802430 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:18:56.802774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:18:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:18:57.602036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:57.602724 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:57.609661 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:57.610150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:57.610930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:57.611370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:57.682895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:57.691696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cc468380-ae99-4c3c-96f4-95f7eb9e3315 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093438 Nov 19 20:18:57.692250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2324/4661] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:58.711891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:58.712549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:58.725152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:58.725591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:58.726395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:58.726822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:58.796046 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:58.804650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-530e0b76-9d2a-4d80-812c-2093fe45ecbb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098442 Nov 19 20:18:58.805211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2325/4662] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:18:59.826479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:18:59.827216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:18:59.834802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:59.835276 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:59.836048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:18:59.836488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:18:59.909196 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:18:59.918224 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-15d904b6-e91f-4681-9bef-df0f495f6ce4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.095731 Nov 19 20:18:59.918809 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2326/4663] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:18:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:00.936109 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:00.936793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:00.943668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:00.944112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:00.944876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:00.945304 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:01.016995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:01.025643 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d9ed97af-812a-4355-b0ed-db9c70af0534 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093160 Nov 19 20:19:01.026244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2327/4664] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:02.046119 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:02.047183 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:02.054813 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:02.055254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:02.056024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:02.056485 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:02.117337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:02.125632 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8b9b6480-24f5-47a3-aa30-90ec52f3d2b1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085794 Nov 19 20:19:02.126229 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2328/4665] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:03.142932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:03.143627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:03.150387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:03.150832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:03.151585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:03.152014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:03.232365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:03.241374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-136d8316-a853-461c-9b83-43221ea3a435 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.102120 Nov 19 20:19:03.241942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2329/4666] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:04.258870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:04.259471 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:04.266555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:04.267012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:04.267789 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:04.268285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:04.337489 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:04.346083 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0b29329d-fdc1-4d1b-af9f-727bfc761df2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090887 Nov 19 20:19:04.346968 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2330/4667] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:05.363856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:05.364674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:05.371669 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:05.372115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:05.372907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:05.373332 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:05.446974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:05.455717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9672fc99-ba1f-494a-b043-004846ed3ed8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.095770 Nov 19 20:19:05.456657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2331/4668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:06.473080 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:06.473797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:06.480387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:06.480831 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:06.481605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:06.482035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:06.551318 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:06.559604 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bee3a97b-abc7-45b3-889d-bf8cc278f0fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090398 Nov 19 20:19:06.560147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2332/4669] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:07.577009 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:07.577680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:07.584590 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:07.585043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:07.585816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:07.586262 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:07.650423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:07.661988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9add35e6-7705-402e-9dab-7d0e87690ac0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088841 Nov 19 20:19:07.662602 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2333/4670] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:19:08.679887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:08.680558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:08.687225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:08.687667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:08.688439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:08.688870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:08.756828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:08.765555 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e955fd98-2b79-4d11-bcea-a3254a082d94 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089787 Nov 19 20:19:08.766145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2334/4671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:09.783442 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:09.784259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:09.791043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:09.791517 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:09.792287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:09.792716 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:09.853951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:09.862667 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b1a06626-2570-4465-8606-de20c97ecb35 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.082907 Nov 19 20:19:09.863240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2335/4672] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:19:10.882013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:10.882749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:10.890041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:10.890508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:10.891295 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:10.891721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:10.958626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:10.967863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6a0abc8-63d1-4dc7-9777-da0683e309e9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090324 Nov 19 20:19:10.968601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2336/4673] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:11.986732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:11.987898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:11.994843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:11.995287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:11.996069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:11.996494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:12.060870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:12.072679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0b43abf6-4b2c-41b1-85aa-7e60b783a636 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089618 Nov 19 20:19:12.073263 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2337/4674] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:13.093505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:13.094256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:13.101152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:13.101592 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:13.102534 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:13.102993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:13.168364 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:13.176908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ef3d264b-091d-4220-a9b7-5d9fc0fdfc2e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087943 Nov 19 20:19:13.177475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2338/4675] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:14.194365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:14.195094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:14.201914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:14.202381 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:14.203176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:14.203586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:14.278952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:14.288056 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dfc188b7-1486-48b4-bcd6-315ec899070c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097474 Nov 19 20:19:14.288621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2339/4676] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:15.308150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:15.308822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:15.317938 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:15.318427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:15.319198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:15.319634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:15.385035 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:15.397326 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b9e944b3-d3fe-4af3-b169-15305327e7fd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094124 Nov 19 20:19:15.398215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2340/4677] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:16.418089 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:16.418886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:16.425456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:16.425905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:16.426714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:16.427147 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:16.490176 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:16.500622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9747898-3523-46cf-9b6e-5c0255b211a1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086139 Nov 19 20:19:16.501179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2341/4678] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:17.522852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:17.523511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:17.529574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:17.530055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:17.530829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:17.531254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:17.600758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:17.608782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5359c1e2-28fc-4c6d-bbd4-12f87243d57a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090712 Nov 19 20:19:17.609343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2342/4679] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:18.634548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:18.635664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:18.644937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:18.645388 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:18.646181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:18.646608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:18.707538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:18.716435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7da807cb-c0c6-4aa2-aa0c-6757496df2a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088259 Nov 19 20:19:18.717001 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2343/4680] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:19.739729 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:19.740416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:19.747012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:19.747425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:19.748219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:19.748642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:19.820636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:19.832603 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-974c4b17-c52a-41db-945b-3fbba3a6adbf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096595 Nov 19 20:19:19.833527 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2344/4681] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:20.850900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:20.851670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:20.858459 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:20.858910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:20.859695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:20.860133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:20.923418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:20.931965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f42b7fde-cb57-4c92-9fad-3799e635d220 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.084964 Nov 19 20:19:20.932547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2345/4682] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:21.950870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:21.951718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:21.960753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:21.961288 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:21.962368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:21.962909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:22.033191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:22.043319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4ed67f96-eb38-492d-8b5b-a1781d03950e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097527 Nov 19 20:19:22.043927 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2346/4683] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:23.065827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:23.066588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:23.073646 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:23.074093 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:23.074900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:23.075339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:23.142486 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:23.151921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-77d96ca1-af18-4bb8-a20f-6154203f2b50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089718 Nov 19 20:19:23.152544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2347/4684] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:24.169120 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:24.169881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:24.177717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:24.178315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:24.179445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:24.180022 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:24.245601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:24.256687 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-34295182-8ca1-4789-9828-97e67c8feceb tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090991 Nov 19 20:19:24.257287 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2348/4685] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:25.274163 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:25.274885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:25.281778 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:25.282247 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:25.283028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:25.283436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:25.354642 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:25.363711 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3cdaed38-c0d8-47aa-826e-8aa4b702005e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093498 Nov 19 20:19:25.364605 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2349/4686] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:26.385137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:26.386197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:26.392709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:26.393179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:26.394135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:26.394599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:26.473219 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:26.486194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8b88cb4d-5c3a-48e8-90a1-d4934a31054f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.104540 Nov 19 20:19:26.487127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2350/4687] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:27.504360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:27.505933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:27.511726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:27.512174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:27.512952 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:27.513382 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:27.572511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:27.584784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c870511d-9324-4ba5-8166-95a52db1e979 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.083982 Nov 19 20:19:27.585774 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2351/4688] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:28.610497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:28.611466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:28.618829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:28.619273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:28.620036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:28.620461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:28.699728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:28.712976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-71c5e1e8-6257-437a-b099-e6cfd6c46813 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.108172 Nov 19 20:19:28.714012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2352/4689] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:29.735260 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:29.735944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:29.742925 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:29.743371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:29.744137 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:29.744565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:29.815976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:29.824613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-35b5e9f7-6695-4d95-a01a-a0bb74f18d88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092981 Nov 19 20:19:29.825188 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2353/4690] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:30.847802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:30.848821 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:30.856418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:30.856866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:30.857631 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:30.858069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:30.926313 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:30.935493 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-29cc7755-3561-4d2e-92f8-676f87256c05 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093642 Nov 19 20:19:30.936069 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2354/4691] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:31.952613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:31.953317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:31.959939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:31.960373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:31.961272 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:31.961698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:32.034546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:32.046630 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81b855cc-4d92-41a3-9df3-8fff989a4cce tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097423 Nov 19 20:19:32.047372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2355/4692] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:33.067981 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:33.068965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:33.076802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:33.077258 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:33.078068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:33.078516 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:33.156574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:33.165475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-899c5470-4196-4e97-9096-6e822353272f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.103750 Nov 19 20:19:33.166088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2356/4693] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:33 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:34.183866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:34.184591 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:34.191504 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:34.191951 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:34.192718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:34.193201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:34.255832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:34.265201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-07600b48-4ef6-4219-9512-659a6028223b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085312 Nov 19 20:19:34.265785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2357/4694] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:35.282707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:35.283376 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:35.290144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:35.290596 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:35.291393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:35.291820 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:35.364793 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:35.375406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f90d820a-719d-40b3-9b64-4a6653d74010 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096308 Nov 19 20:19:35.376078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2358/4695] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:36.396776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:36.397854 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:36.405573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:36.406013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:36.406828 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:36.407256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:36.475788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:36.484567 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ea24e78-1c3b-4490-aae0-abcb435c366e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093170 Nov 19 20:19:36.485153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2359/4696] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:37.507345 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:37.508003 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:37.515680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:37.516142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:37.516901 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:37.517317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:37.580728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:37.590859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-25635f57-85ca-40de-b741-9a68fd7f053d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089077 Nov 19 20:19:37.591701 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2360/4697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:38.609787 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:38.610496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:38.617018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:38.617466 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:38.618300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:38.618733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:38.695013 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:38.703876 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3da6a184-4121-4f61-925c-471ad04c92d2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098598 Nov 19 20:19:38.704450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2361/4698] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:39.724984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:39.725728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:39.733750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:39.734217 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:39.734964 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:39.735413 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:39.801678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:39.809882 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5a580265-1873-427b-a030-26cc50d0f836 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090752 Nov 19 20:19:39.810470 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2362/4699] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:40.826578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:40.827292 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:40.833880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:40.834350 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:40.835223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:40.835652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:40.899227 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:40.907833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8393370b-048a-477e-b56c-2c62d923aa34 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085155 Nov 19 20:19:40.908404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2363/4700] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:41.924923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:41.925649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:41.932418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:41.932863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:41.933636 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:41.934153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:41.999032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:42.012573 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d252aaaf-a83c-478b-8d91-10ad3585300f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090977 Nov 19 20:19:42.013491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2364/4701] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:19:43.033156 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:43.033899 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:43.042523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:43.043098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:43.044121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:43.044753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:43.124562 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:43.132960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-868db337-ac35-4f1a-8783-e29cf6fce974 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.105702 Nov 19 20:19:43.133533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2365/4702] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:43 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:44.151533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:44.152331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:44.159135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:44.159583 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:44.160488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:44.160922 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:44.226502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:44.237131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4fe4cd4b-f7b6-4220-98bc-064012b28f50 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089348 Nov 19 20:19:44.237707 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2366/4703] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:45.254785 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:45.255349 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:45.263250 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:45.263690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:45.264462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:45.264979 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:45.326721 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:45.335856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9605d85b-43f5-46d3-9669-fc4554ce6e7b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.084707 Nov 19 20:19:45.336423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2367/4704] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:46.352730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:46.353404 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:46.361049 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:46.361497 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:46.362337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:46.362767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:46.430221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:46.438756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-50f5803b-f9f6-41d9-ab7e-8b3e95c83927 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089608 Nov 19 20:19:46.439317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2368/4705] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:47.456668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:47.457370 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:47.464271 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:47.464702 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:47.465491 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:47.465894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:47.532704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:47.541081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ec028fd2-beae-4f41-8c43-2cb015949132 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088762 Nov 19 20:19:47.541674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2369/4706] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:48.557750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:48.558396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:48.564843 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:48.565281 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:48.566064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:48.566492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:48.636866 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:48.644991 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-81217209-ee1c-45d1-a60a-963d70ae5136 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090936 Nov 19 20:19:48.645584 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2370/4707] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:49.668727 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:49.669440 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:49.675816 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:49.676256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:49.677103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:49.677538 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:49.742024 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:49.750461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bb8c6ca0-5f44-4629-9382-a61d97cf70f5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091483 Nov 19 20:19:49.751037 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2371/4708] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:50.771368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:19:50.772098 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:19:50.779201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:50.779647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:50.780439 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:19:50.780870 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:19:50.850953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:19:50.859374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-407f17ca-cbb3-4dfa-8893-cd4c9bbdca3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094056 Nov 19 20:19:50.859929 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2372/4709] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:19:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:19:50.935274 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bd34b99e-5cb7-48f5-8c00-aa03085530ca tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb42d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:48.459158 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e365112f-2cc9-4184-8588-69c00baf9e3f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 117.648929 Nov 19 20:20:48.459859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2338/4710] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:18:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 117651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:20:48.465561 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:48.466316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:48.474213 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:48.474824 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:48.475446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:48.475871 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:48.557101 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:48.565825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4def485a-e2e6-449f-b7f3-89ab06adf107 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.104657 Nov 19 20:20:48.575237 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2339/4711] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:48.634502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bd34b99e-5cb7-48f5-8c00-aa03085530ca tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 57.765423 Nov 19 20:20:48.635064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2373/4712] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:19:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:20:48.680759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04506139-a88f-41e8-a778-8295b862bcb9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca8fdc0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:49.584869 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:49.585374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:49.592797 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:49.593236 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:49.594015 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:49.594524 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:49.661638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:49.670415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9e3982a2-eeb0-435a-9c76-fe0e1d84407f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090886 Nov 19 20:20:49.670972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2374/4713] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:49.677538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:20:49.678083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:20:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:20:49.886187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:20:49.886187 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:20:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:20:49.980921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-04506139-a88f-41e8-a778-8295b862bcb9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] HTTP exception thrown: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-20fb48e7-997f-4af5-9537-0e3aa9db0879) Nov 19 20:20:49.982117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-04506139-a88f-41e8-a778-8295b862bcb9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Returning 400 to user: Invalid input received: Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer. (HTTP 400) (Request-ID: req-20fb48e7-997f-4af5-9537-0e3aa9db0879) {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:20:49.983204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-04506139-a88f-41e8-a778-8295b862bcb9 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 400 len: 375 microversion: 2.1 time: 1.306246 Nov 19 20:20:49.985433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2340/4714] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Nov 19 20:20:48 2021] DELETE /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 375 bytes in 1309 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 19 20:20:49.993112 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9cf515b-85b6-43b6-8d8a-5edc6cfa56d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832f9d0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:50.067862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9cf515b-85b6-43b6-8d8a-5edc6cfa56d0 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.078313 Nov 19 20:20:50.068435 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2375/4715] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:20:49 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:20:50.693652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:50.694882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:50.703096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:50.703615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:50.704589 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:50.705558 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:50.840725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:50.853608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dcd8785c-5112-4113-a40a-1f9fca9c2ebd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.165683 Nov 19 20:20:50.863380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2341/4716] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:51.081314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7cfb62b0-3dc7-4387-a2b3-ab09ca953c3f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca63b80>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:51.165660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7cfb62b0-3dc7-4387-a2b3-ab09ca953c3f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.088006 Nov 19 20:20:51.171992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2376/4717] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:20:51 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:20:51.191528 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-58ae7070-5b8b-46b1-b56e-5087ed812a40 req-e09b5cb3-27e9-4463-b7db-6511bb723dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55b5c82-d731-4c63-aa4f-3ba1a695dee4", "name": "network-vif-deleted", "tag": "40d74c88-0870-43ff-b0ec-f8f15e67e8e3"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:20:51.194749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:20:51.194749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:20:51.204193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-58ae7070-5b8b-46b1-b56e-5087ed812a40 req-e09b5cb3-27e9-4463-b7db-6511bb723dc4 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:51.205017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-58ae7070-5b8b-46b1-b56e-5087ed812a40 req-e09b5cb3-27e9-4463-b7db-6511bb723dc4 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:51.224442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-58ae7070-5b8b-46b1-b56e-5087ed812a40 req-e09b5cb3-27e9-4463-b7db-6511bb723dc4 service nova] Creating event network-vif-deleted:40d74c88-0870-43ff-b0ec-f8f15e67e8e3 for instance d55b5c82-d731-4c63-aa4f-3ba1a695dee4 on hv-cinder-77703 Nov 19 20:20:51.230013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-58ae7070-5b8b-46b1-b56e-5087ed812a40 req-e09b5cb3-27e9-4463-b7db-6511bb723dc4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043963 Nov 19 20:20:51.230643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2342/4718] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:20:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:20:51.872750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:51.873339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:51.880060 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:51.880385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:51.881167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:51.881599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:51.945969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:51.954752 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a3a86407-38bd-4e3c-862d-6f87013a39d5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085572 Nov 19 20:20:51.955600 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2377/4719] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:52.180150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6b90d501-135f-447a-822a-155325913f4c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14c98f940>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:52.972677 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:52.973286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:52.980055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:52.980499 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:52.981704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:52.981704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:53.055582 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:53.066092 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-86911394-8262-4c6a-af70-4442c1bc7d7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097206 Nov 19 20:20:53.066757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2378/4720] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:54.086764 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:54.087753 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:54.097157 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:54.097571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:54.098420 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:54.098868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:54.159178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:54.167186 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-095a7335-644d-4685-989a-9cf5b7a35197 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086697 Nov 19 20:20:54.167742 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2379/4721] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:54 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:55.184696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:55.185496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:55.192210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:55.192665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:55.193456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:55.193885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:55.270311 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:55.279533 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-4891b49f-bd5e-4497-88f2-9e1612578231 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098627 Nov 19 20:20:55.280155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2380/4722] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:56.299559 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:56.300231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:56.309829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:56.310511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:56.311419 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:56.311924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:56.375273 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:56.383852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-89d0f726-ac24-4a02-b2b7-9683fb8e23dd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089048 Nov 19 20:20:56.384412 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2381/4723] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:20:57.401012 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:57.401740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:57.408488 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:57.408912 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:57.409719 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:57.410182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:57.483150 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:57.492153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e6a3b62d-a83d-4aa9-8e7c-cd5b86b0d6ea tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094932 Nov 19 20:20:57.492710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2382/4724] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:58.509074 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:58.509732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:58.516211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:58.516657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:58.517428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:58.517862 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:58.579095 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:58.587405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a2ccec8f-4035-4f15-aa02-426bd194670a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.082155 Nov 19 20:20:58.587973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2383/4725] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:20:59.605265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:20:59.605958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:20:59.613715 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:59.614199 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:59.615055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:20:59.615503 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:20:59.682181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:20:59.691194 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6a51ce21-1399-4f90-bf15-c069235f74db tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089499 Nov 19 20:20:59.691780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2384/4726] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:20:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:00.180204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:21:00.180826 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:21:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:21:00.710265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:00.710886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:00.718256 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:00.718736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:00.719558 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:00.720025 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:00.789113 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:00.802919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3bde58ef-3c99-45ae-bf33-923cd4eb9eb1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097041 Nov 19 20:21:00.803836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2385/4727] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:01.826073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:01.826844 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:01.834539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:01.834982 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:01.835747 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:01.836172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:01.906611 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:01.915800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a4bd465c-ee22-40b0-b70b-979c15473ff8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093966 Nov 19 20:21:01.916738 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2386/4728] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:02.934126 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:02.934865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:02.943210 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:02.943684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:02.944444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:02.944879 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:03.017198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:03.025788 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-67621976-900d-436e-93b1-256b54fc4f7c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096929 Nov 19 20:21:03.026386 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2387/4729] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:04.043465 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:04.044153 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:04.051384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:04.051830 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:04.052601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:04.053314 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:04.118658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:04.127429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cbeba2fd-2c16-44dd-a348-9e2b0c4cbc8c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087907 Nov 19 20:21:04.127995 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2388/4730] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:05.147827 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:05.148539 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:05.155458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:05.155908 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:05.156671 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:05.157096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:05.218674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:05.227541 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-9528075f-3066-42f6-b285-94015176e826 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.083407 Nov 19 20:21:05.228127 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2389/4731] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:05 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:06.247392 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:06.248135 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:06.257886 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:06.258652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:06.259760 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:06.260308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:06.329635 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:06.339213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1b4d15a3-4a0b-440b-bfcb-974b9cfa97be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097053 Nov 19 20:21:06.340990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2390/4732] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:07.358786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:07.359644 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:07.368615 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:07.369315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:07.370676 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:07.371422 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:07.437847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:07.446622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c68f30ca-3a5a-425d-be2b-56f44fc5961f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092463 Nov 19 20:21:07.447200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2391/4733] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:08.465087 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:08.465829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:08.472329 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:08.473480 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:08.474455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:08.474977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:08.555656 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:08.568138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-aa39d319-dd12-4235-8d6d-be337295dbab tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.107545 Nov 19 20:21:08.568933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2392/4734] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:09.591429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:09.592121 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:09.599795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:09.600244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:09.601036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:09.601469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:09.668514 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:09.677266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-272f0cbf-194c-4403-912e-58610bdbfb7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089904 Nov 19 20:21:09.677848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2393/4735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:10.694316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:10.695002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:10.701832 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:10.702296 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:10.703140 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:10.703565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:10.936690 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:10.945472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7645fa31-e414-4404-a730-7b17296a5a0e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.254930 Nov 19 20:21:10.945958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2394/4736] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:11.967133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:11.968106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:11.976626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:11.977077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:11.977852 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:11.978317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:12.047336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:12.056131 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-40964beb-91df-48ce-8778-eca8ca784935 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094713 Nov 19 20:21:12.056659 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2395/4737] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:13.074026 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:13.074836 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:13.081299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:13.081749 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:13.082579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:13.083399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:13.152728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:13.161478 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3c8854a2-66dd-43be-9a4d-a0ddb56de6b9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090904 Nov 19 20:21:13.162589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2396/4738] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:14.182700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:14.183450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:14.192360 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:14.193351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:14.194155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:14.194594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:14.266397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:14.275195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d2d28325-41aa-47bd-ac63-953151b33fa5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098954 Nov 19 20:21:14.275796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2397/4739] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:15.292312 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:15.293084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:15.299967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:15.300429 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:15.301218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:15.301691 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:15.366713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:15.375125 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6c91cc97-4834-44d0-94ee-5095a0dbb026 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086393 Nov 19 20:21:15.375686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2398/4740] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:15 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:16.392544 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:16.393277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:16.400693 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:16.401152 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:16.401930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:16.402391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:16.466990 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:16.475102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ea83c665-e381-41a9-883e-cb795254a301 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086267 Nov 19 20:21:16.475664 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2399/4741] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:17.493343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:17.494094 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:17.500692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:17.501144 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:17.501935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:17.502402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:17.571885 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:17.580284 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-615a6924-ab73-4c03-9e25-0ed73db0950d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091462 Nov 19 20:21:17.580825 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2400/4742] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:18.598215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:18.599067 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:18.605865 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:18.606496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:18.607344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:18.607856 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:18.676723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:18.685622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5e10a25d-9087-4274-a47b-a745c81f60e4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091016 Nov 19 20:21:18.686225 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2401/4743] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:19.703924 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:19.704652 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:19.711734 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:19.712181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:19.712969 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:19.713758 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:19.782468 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:19.790932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-25711176-de41-45a6-b93a-3380675a1fde tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090769 Nov 19 20:21:19.791494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2402/4744] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:20.807811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:20.808626 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:20.815168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:20.815618 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:20.816408 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:20.816847 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:20.881081 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:20.889887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-8e2c9f86-a480-41de-aa7d-992f7781f873 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085824 Nov 19 20:21:20.890515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2403/4745] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:21.908438 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:21.909300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:21.916285 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:21.916731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:21.917521 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:21.917954 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:21.985106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:21.993914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-01be8ffb-e5f7-439e-ad27-e18c3ef8a8f7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089200 Nov 19 20:21:21.994525 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2404/4746] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:23.012198 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:23.013076 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:23.020139 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:23.020779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:23.021893 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:23.022513 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:23.101941 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:23.111018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5af9db69-ae82-4acf-8338-a2a06ddc9045 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.102681 Nov 19 20:21:23.111608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2405/4747] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:24.128190 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:24.128904 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:24.136006 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:24.136417 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:24.137233 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:24.137657 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:24.203202 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:24.215330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1ce8a581-d17c-4c14-a80b-b94ada965cdc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090724 Nov 19 20:21:24.216698 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2406/4748] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:25.236608 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:25.237393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:25.246845 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:25.247421 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:25.248240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:25.248910 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:25.318755 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:25.328399 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a7d3e1b3-e411-41ea-8d6e-490a76a3efcf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097325 Nov 19 20:21:25.328950 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2407/4749] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:25 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:26.347200 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:26.347905 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:26.355142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:26.355588 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:26.356384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:26.356822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:26.430402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:26.439840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-631df4f4-ae9e-4bf9-9b53-d43464f7b9a3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096469 Nov 19 20:21:26.440425 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2408/4750] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:27.457428 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:27.458342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:27.466218 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:27.466663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:27.467505 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:27.467944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:27.536700 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:27.546456 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-08ab41b1-9dcf-4cea-954d-5d98fbdeb8ad tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092606 Nov 19 20:21:27.547055 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2409/4751] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:28.566145 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:28.566897 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:28.573900 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:28.574373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:28.575167 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:28.575571 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:28.642549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:28.652148 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-3eee4296-21d8-419d-8f9c-c921094ba49f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089797 Nov 19 20:21:28.652907 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2410/4752] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:29.677201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:29.677940 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:29.685002 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:29.685445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:29.686240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:29.686678 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:29.757328 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:29.771937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85aa3283-84a2-49ad-9637-d1ce7ece5af5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096995 Nov 19 20:21:29.772888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2411/4753] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:30.797736 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:30.798492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:30.806303 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:30.806748 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:30.807637 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:30.808064 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:30.871782 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:30.880621 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1a522d81-d7b6-4c4c-b84b-b42b39bcc164 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086781 Nov 19 20:21:30.881204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2412/4754] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:31.898568 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:31.899324 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:31.905767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:31.906231 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:31.907034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:31.907464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:31.974342 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:31.982501 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dbfed2d2-de55-40f4-8e70-60a8bab0f000 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087789 Nov 19 20:21:31.983068 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2413/4755] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:33.000028 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:33.000859 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:33.008181 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:33.008634 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:33.009457 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:33.009894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:33.093243 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:33.102341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-bb0af625-08f0-4ccc-9dc8-4f7b55d60421 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.106073 Nov 19 20:21:33.102949 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2414/4756] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:34.120269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:34.121418 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:34.129779 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:34.130436 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:34.131692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:34.132179 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:34.205733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:34.217973 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-682a8f5c-5f84-4ebb-9baa-bcf9034df201 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.101323 Nov 19 20:21:34.218988 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2415/4757] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:35.237300 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:35.238091 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:35.245593 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:35.246084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:35.246967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:35.247416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:35.312221 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:35.320494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e0578c15-cb5c-4281-aa6b-f9275a9bd0be tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087215 Nov 19 20:21:35.321073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2416/4758] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:36.337379 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:36.338103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:36.345289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:36.345739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:36.346822 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:36.346972 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:36.414917 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:36.427044 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-fafa7b08-65dd-4a17-9222-7e054036365c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092959 Nov 19 20:21:36.427619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2417/4759] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:37.448154 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:37.448918 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:37.455552 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:37.456005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:37.456770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:37.457197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:37.523223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:37.535193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-be0f05d1-b75c-47da-92df-35c38451fafc tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090451 Nov 19 20:21:37.535895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2418/4760] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:38.557502 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:38.558556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:38.564957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:38.565395 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:38.566240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:38.566665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:38.637868 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:38.646484 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-72f55b15-4cc1-448b-92a6-3f6f63f58c6c tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092693 Nov 19 20:21:38.647061 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2419/4761] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:39.663860 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:39.664610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:39.671565 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:39.672014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:39.672800 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:39.673232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:39.739943 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:39.748293 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f9a9fbd3-c044-415c-93f3-8516a9588b86 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088772 Nov 19 20:21:39.748864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2420/4762] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:40.767833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:40.768665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:40.776149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:40.776679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:40.777745 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:40.778389 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:40.848610 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:40.857254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7254d43a-92ef-4157-83f4-99aa6f8f47d6 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094599 Nov 19 20:21:40.857829 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2421/4763] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:41.874994 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:41.876165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:41.883103 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:41.883548 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:41.884351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:41.884777 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:41.953674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:41.966433 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-16ce4dc6-6d95-48eb-b559-f71b25f79bc2 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.095327 Nov 19 20:21:41.967215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2422/4764] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:42.984034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:42.984767 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:42.992106 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:42.992551 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:42.993341 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:42.993771 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:43.058010 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:43.066319 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-32c36e3d-9c68-4eeb-80c7-e01f39158620 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086398 Nov 19 20:21:43.066909 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2423/4765] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:44.082953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:44.083681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:44.091264 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:44.091713 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:44.092508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:44.092931 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:44.156649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:44.166084 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d561ae8f-01ec-4455-9899-837d8017d766 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086780 Nov 19 20:21:44.166692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2424/4766] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:44 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:45.183371 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:45.184077 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:45.191130 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:45.191574 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:45.192351 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:45.192776 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:45.254400 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:45.269754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-f7c44018-b688-4ac6-8c5e-57009bb129a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090034 Nov 19 20:21:45.270387 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2425/4767] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:46.288896 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:46.289666 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:46.296277 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:46.296722 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:46.297492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:46.297923 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:46.364796 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:46.373406 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0250f563-fa1b-4a85-bfaa-45b02edda717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088846 Nov 19 20:21:46.373975 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2426/4768] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:47.391819 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:47.392415 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:47.399244 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:47.399684 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:47.400455 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:47.400880 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:47.471391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:47.479650 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-650247c8-42b8-4a0b-bd8c-c50c078d8ea7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091685 Nov 19 20:21:47.480204 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2427/4769] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:21:48.498692 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:48.499353 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:48.506714 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:48.507102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:48.507919 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:48.508385 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:48.574638 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:48.586812 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-146f12f5-0477-4d31-a23a-9f3c55d6d202 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092951 Nov 19 20:21:48.587833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2428/4770] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:49.604695 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:49.605347 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:49.611921 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:49.612369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:49.613149 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:49.613589 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:49.679402 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:49.687384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-22353f0a-3c92-4e36-b55d-bfa9c018902f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086539 Nov 19 20:21:49.687955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2429/4771] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:50.704807 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:50.705452 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:50.712294 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:50.712743 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:50.713841 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:50.714317 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:50.774506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:50.783201 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c58621a1-981f-4a0c-84be-c3a9629cec0b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.082273 Nov 19 20:21:50.783786 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2430/4772] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:51.802913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:21:51.803857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:21:51.812448 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:51.813054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:51.814102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:21:51.814732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:21:51.880508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:21:51.893339 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-acb13759-6666-4237-a3ba-8dee01e6fe11 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.095345 Nov 19 20:21:51.894275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2431/4773] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:21:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:21:52.240578 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-eacea37d-9925-4620-88d3-deb02f8bb235 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14831cca0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:13.275955 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:22:13.276581 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:22:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:22:16.827754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:22:16.828710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:22:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:22:49.329079 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6b90d501-135f-447a-822a-155325913f4c tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 117.153167 Nov 19 20:22:49.329654 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2343/4774] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:20:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 117155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:22:49.473988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:49.474939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:49.483087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:49.483530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:49.484517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:49.484968 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:49.577575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:49.586478 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-39a9761d-51d1-4031-8392-ebdf5dcbdc3e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.255765 Nov 19 20:22:49.587055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2344/4775] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:49.710730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-eacea37d-9925-4620-88d3-deb02f8bb235 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 57.473881 Nov 19 20:22:49.711532 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2432/4776] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:21:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:22:50.607778 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:50.608377 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:50.617254 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:50.617725 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:50.618498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:50.618926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:50.682666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:50.690909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6ca523ec-01a4-44af-bf42-1864f95c163e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089109 Nov 19 20:22:50.691469 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2345/4777] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:50.724848 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-678369e4-d2e2-40f3-8b1e-f9b6f62af227 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca06280>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:51.379462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-678369e4-d2e2-40f3-8b1e-f9b6f62af227 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.658648 Nov 19 20:22:51.380021 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2433/4778] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:22:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:22:51.711622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:51.712217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:51.720863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:51.721436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:51.722683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:51.723205 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:51.788935 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:51.800609 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7aff3337-06ac-425d-9d2c-5734e0132f7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094768 Nov 19 20:22:51.801184 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2346/4779] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:52.393269 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d7c03aaa-274d-441b-a4bf-5eeff8610b19 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14832fc10>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:52.820298 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:52.820997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:52.827661 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:52.828111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:52.828880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:52.829310 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:52.893917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:52.902624 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ec45f755-7111-4ef8-a76c-abaa74da4e7d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086043 Nov 19 20:22:52.903198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2347/4780] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:52 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:53.921920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:53.922684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:53.929381 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:53.929829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:53.930630 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:53.931061 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:54.001696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:54.010195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fb41326f-d26d-495d-95e1-8042233ff8bf tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092697 Nov 19 20:22:54.010779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2348/4781] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:53 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:55.027675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:55.028392 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:55.034990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:55.035434 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:55.036178 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:55.036632 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:55.101996 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:55.110243 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b18e655e-741e-4d1b-b542-3f1f530a9714 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086304 Nov 19 20:22:55.110819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2349/4782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:55 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:56.128921 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:56.129626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:56.138032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:56.138573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:56.139372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:56.139805 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:56.203410 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:56.211795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88c8533f-ffa4-49a9-af94-4c4c9dd9c975 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087445 Nov 19 20:22:56.212333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2350/4783] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:56 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:57.228750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:57.229541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:57.236592 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:57.237104 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:57.237838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:57.238308 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:57.302500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:57.311529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3cc2d48b-aa53-4715-a5ba-981d202873f9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086409 Nov 19 20:22:57.312091 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2351/4784] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:57 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:58.333702 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:58.334427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:58.342090 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:58.342539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:58.343521 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:58.343961 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:58.414863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:58.423501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-be7b6fec-508f-4fc7-8c0e-36f5ce180a36 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094045 Nov 19 20:22:58.424098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2352/4785] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:58 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:22:59.441955 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:22:59.442683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:22:59.449447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:59.449894 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:59.450835 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:22:59.451409 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:22:59.531191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:22:59.541334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-10804f41-635a-48a1-81cd-1ad49c8db722 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.103324 Nov 19 20:22:59.541919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2353/4786] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:22:59 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:00.558899 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:00.559570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:00.566020 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:00.566498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:00.567263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:00.567692 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:00.632117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:00.643768 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-13838cf5-6c78-4a26-9824-1c995ea1c956 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088828 Nov 19 20:23:00.644497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2354/4787] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:00 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:01.668615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:01.669277 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:01.677019 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:01.677461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:01.678271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:01.678700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:01.753602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:01.762100 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a14e8d88-7a5d-44a4-ac97-b9199a616584 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.099118 Nov 19 20:23:01.762708 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2355/4788] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:01 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:02.779342 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:02.780044 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:02.787174 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:02.787621 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:02.788385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:02.788815 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:02.859016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:02.867523 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c102dd29-83c3-40ba-87c7-62fc2cd2cd78 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091899 Nov 19 20:23:02.868085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2356/4789] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:02 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:03.885134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:03.885865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:03.893653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:03.894135 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:03.894909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:03.895344 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:03.966825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:03.975825 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5b82e8f0-66de-40d9-8cd9-ec2efe733fd4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094594 Nov 19 20:23:03.976393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2357/4790] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:03 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:04.997330 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:04.998072 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:05.005898 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:05.006394 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:05.007169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:05.007607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:05.079023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:05.093369 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ea072f90-8d26-4b38-badd-522bb68f0659 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.099755 Nov 19 20:23:05.093947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2358/4791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:04 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:06.113595 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:06.114500 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:06.121059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:06.121520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:06.122335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:06.122774 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:06.187282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:06.199335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1dee91dd-9ca8-4e03-bfb8-be1d1c4f5b46 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090957 Nov 19 20:23:06.200132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2359/4792] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:06 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:07.219596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:07.220273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:07.227757 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:07.228180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:07.228973 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:07.229406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:07.294857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:07.303479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bea1320b-bfca-47d0-a499-3844add329b3 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.088864 Nov 19 20:23:07.304048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2360/4793] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:07 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:08.323212 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:08.323889 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:08.330554 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:08.330997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:08.331758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:08.332188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:08.405395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:08.414173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9462d60f-c3b3-4958-a56b-232aa8a6e670 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094629 Nov 19 20:23:08.414754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2361/4794] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:08 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:09.433323 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:09.434108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:09.442901 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:09.443417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:09.444568 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:09.445115 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:09.512181 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:09.520922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a5e1d834-c4e6-4f1a-82f3-f0a599b3beff tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093103 Nov 19 20:23:09.521648 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2362/4795] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:09 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:10.540009 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:10.540670 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:10.547878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:10.548326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:10.549099 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:10.549532 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:10.624149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:10.633622 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-220abc81-2198-47f4-8cba-a4a6f91809c1 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098046 Nov 19 20:23:10.634233 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2363/4796] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:10 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:11.655102 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:11.655796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:11.662272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:11.662711 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:11.663501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:11.663926 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:11.724520 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:11.732664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-dc2b0082-5d19-43d3-8b0e-8920de8bbcf5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.081468 Nov 19 20:23:11.733219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2364/4797] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:11 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:12.753267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:12.753990 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:12.761285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:12.761710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:12.762551 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:12.763069 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:12.826882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:12.837177 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d586b002-92ee-4cc3-a8e8-45408a709487 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089667 Nov 19 20:23:12.837749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2365/4798] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:12 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:13.857458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:13.858156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:13.866537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:13.866980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:13.867742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:13.868167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:13.939780 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:13.948796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0eb49f8a-c065-44f0-9426-53e8aabef15b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096979 Nov 19 20:23:13.949354 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2366/4799] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:13 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:14.968862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:14.969576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:14.977734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:14.978230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:14.978988 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:14.979411 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:15.052939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:15.061800 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c1b590a2-7789-4bd4-8158-7b77e08125cd tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.098726 Nov 19 20:23:15.062557 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2367/4800] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:14 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:16.079675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:16.080422 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:16.087508 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:16.087951 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:16.089092 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:16.089518 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:16.158538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:16.166703 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f66e8a56-54df-4bff-ac4a-bc5c65379b8e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090740 Nov 19 20:23:16.167260 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2368/4801] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:16 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:17.184221 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:17.184976 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:17.191689 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:17.192132 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:17.192893 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:17.193317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:17.267026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:17.278179 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4042d72b-84f5-434f-ad10-17af356ca68a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097715 Nov 19 20:23:17.278759 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2369/4802] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:17 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:18.298385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:18.299095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:18.306155 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:18.306587 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:18.307357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:18.307791 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:18.368809 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:18.377111 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-12d201fe-e2f9-46f8-a416-abfbaa1c2e9d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.082417 Nov 19 20:23:18.377686 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2370/4803] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:18 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:19.402749 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:19.403658 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:19.413491 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:19.413945 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:19.414750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:19.415182 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:19.485223 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:19.493700 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-8d1ac4b6-1757-47b0-9d25-37784b52ca65 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.097713 Nov 19 20:23:19.494226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2371/4804] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:19 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:20.513765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:20.514679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:20.523094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:20.523547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:20.524317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:20.524742 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:20.590289 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:20.599666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-45b0bc3c-49f2-4e08-8e95-50da5d9795fa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091967 Nov 19 20:23:20.600437 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2372/4805] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:20 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:21.627013 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:21.627991 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:21.635792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:21.636241 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:21.637010 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:21.637447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:21.709018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:21.718118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f65dfb92-cd21-4305-99d9-1f82c82dcc8a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.096918 Nov 19 20:23:21.718710 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2373/4806] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:21 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:22.735705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:22.736393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:22.743616 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:22.744046 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:22.744819 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:22.745244 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:22.814662 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:22.822982 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3949a518-1fa6-4cf5-bd4a-7dc941e5415e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090949 Nov 19 20:23:22.823543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2374/4807] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:22 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:23.840941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:23.841754 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:23.848266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:23.848696 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:23.849459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:23.849884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:23.924357 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:23.937329 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-bb7160d9-15f5-4fe3-a886-1339201949c7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.100612 Nov 19 20:23:23.938272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2375/4808] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:23 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:23:24.960446 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:24.961190 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:24.968119 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:24.968574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:24.969339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:24.969770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:25.037841 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:25.046954 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f2c905ac-890e-4d28-993a-aa52b3484b26 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092517 Nov 19 20:23:25.047537 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2376/4809] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:24 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:26.064852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:26.065534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:26.074739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:26.075191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:26.075974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:26.076380 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:26.145346 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:26.154312 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b98686bd-a128-4590-a622-6ee4668233fe tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093150 Nov 19 20:23:26.154866 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2377/4810] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:26 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:27.171896 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:27.172615 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:27.179285 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:27.179734 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:27.180497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:27.180930 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:27.242276 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:27.251023 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-42dcf7fd-db0d-4851-bbe5-c100724246da tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.082804 Nov 19 20:23:27.251597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2378/4811] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:27 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:28.268251 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:28.268932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:28.276497 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:28.277084 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:28.277882 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:28.278367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:28.348941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:28.357572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ef505042-1e8b-49f2-bba9-9467c5d40e95 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092982 Nov 19 20:23:28.358137 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2379/4812] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:28 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:29.377607 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:29.378327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:29.387891 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:29.388348 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:29.389185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:29.389763 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:29.700604 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:29.712644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-c6abd0f2-e471-42da-97c5-7eed3b40b17e tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.340636 Nov 19 20:23:29.713758 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2380/4813] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:29 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:30.737266 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:30.738226 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:30.747563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:30.748188 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:30.749363 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:30.749962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:30.819345 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:30.827675 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88df352b-c884-4a75-826f-ce38a5dfa8af tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.095789 Nov 19 20:23:30.828256 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2381/4814] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:30 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:31.848271 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:31.848978 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:31.856464 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:31.856908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:31.857669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:31.858087 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:31.920180 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:31.928705 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5408a361-82c2-468c-a63b-f98de71a8717 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.086235 Nov 19 20:23:31.929270 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2382/4815] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:31 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:32.946668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:32.947385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:32.953795 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:32.954248 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:32.955018 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:32.955457 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:33.018952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:33.027333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-88a7fb3b-c5a4-4eb1-8234-c8a7efe666c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085012 Nov 19 20:23:33.027903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2383/4816] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:32 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:34.044600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:34.045321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:34.051962 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:34.052415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:34.053217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:34.053652 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:34.115878 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:34.124424 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ddb96567-aec0-4548-8d26-8a145fbd4ca8 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.083574 Nov 19 20:23:34.125016 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2384/4817] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:34 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:35.141590 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:35.142438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:35.149136 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:35.149576 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:35.150393 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:35.150806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:35.214892 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:35.223383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-60b2b3f1-20a2-4399-9451-25e1d5325f18 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085574 Nov 19 20:23:35.223949 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2385/4818] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:35 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:36.241303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:36.242015 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:36.250643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:36.251081 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:36.251838 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:36.252486 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:36.323548 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:36.332326 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-d3546c8b-d6cd-437a-9a01-c5a1345b7e82 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.094891 Nov 19 20:23:36.332880 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2386/4819] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:36 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:37.353085 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:37.354002 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:37.361140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:37.361704 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:37.362643 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:37.363055 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:37.427577 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:37.436217 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-e8e05e42-7f0b-4549-bc54-0e061cfda929 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087012 Nov 19 20:23:37.436808 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2387/4820] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:37 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:23:38.454971 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:38.455939 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:38.465571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:38.466263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:38.467415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:38.468065 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:38.550656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:38.559629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a622f396-08c1-4c0c-973b-e243943e08c5 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.110179 Nov 19 20:23:38.560202 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2388/4821] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:38 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:39.576925 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:39.577659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:39.584530 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:39.585006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:39.585770 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:39.586235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:39.657197 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:39.666280 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-cfac265b-2b77-42c3-9804-b1e4f848df22 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.093049 Nov 19 20:23:39.666853 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2389/4822] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:39 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:40.686562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:40.687379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:40.696665 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:40.697118 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:40.697912 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:40.698382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:40.766922 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:40.779581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-664dc230-7352-41b7-b02d-e1c23aca000f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.099190 Nov 19 20:23:40.780320 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2390/4823] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:40 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:23:41.799950 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:41.800653 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:41.807720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:41.808267 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:41.809863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:41.809863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:41.873282 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:41.881286 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-9f949159-6d90-4279-b240-da257e35486d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.085139 Nov 19 20:23:41.881854 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2391/4824] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:41 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:42.898840 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:42.899556 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:42.906459 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:42.906904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:42.907663 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:42.908095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:42.979574 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:42.987659 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06a1022c-1923-45a2-a2e8-218f25ffe9f4 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092514 Nov 19 20:23:42.988242 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2392/4825] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:42 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:44.004870 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:44.005638 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:44.012560 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:44.013359 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:44.014455 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:44.014903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:44.078920 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:44.089997 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0ccb9f36-4866-48b0-a74b-34253e47129d tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.089395 Nov 19 20:23:44.090650 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2393/4826] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:43 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:45.107395 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:45.108116 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:45.114731 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:45.115173 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:45.115932 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:45.116355 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:45.180423 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:45.191334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-fc3af499-de20-4cd2-a873-61f8ecbc481b tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087632 Nov 19 20:23:45.192140 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2394/4827] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:45 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:23:46.212048 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:46.212683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:46.220571 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:46.221017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:46.221793 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:46.222257 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:46.284685 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:46.296438 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-06f94647-95fa-4a0a-b387-9896d715b456 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.090171 Nov 19 20:23:46.297011 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2395/4828] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:46 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:47.317157 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:47.318117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:47.326165 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:47.326591 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:47.327389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:47.327814 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:47.392617 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:47.400884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b1f83f99-9b03-4271-85a9-f4212421e147 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087631 Nov 19 20:23:47.401462 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2396/4829] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:47 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:48.420263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:48.421114 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:48.429436 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:48.429895 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:48.430928 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:48.431364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:48.497676 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:48.507001 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ebe4aa52-caa8-4735-a33c-8d6f0b810782 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.091736 Nov 19 20:23:48.507489 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2397/4830] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:49.524645 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:49.525382 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:49.531974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:49.532427 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:49.533220 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:49.533660 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:49.614540 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:49.623209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ff414285-2ebf-4a48-a9d3-25e060cfd80f tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.102261 Nov 19 20:23:49.623810 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2398/4831] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:50.641335 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:50.642058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:50.650249 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:50.650766 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:50.651608 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:50.652501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:50.717765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:50.730098 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b03a473c-abe4-4141-947f-b888eb62b9aa tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.092611 Nov 19 20:23:50.730772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2399/4832] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:50 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:51.747852 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:23:51.748543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:23:51.755516 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:51.755933 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:51.756724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:23:51.757150 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:23:51.822258 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:23:51.830947 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-32b3b98d-be7c-4d3f-8fa1-74e12c1ca23a tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.087095 Nov 19 20:23:51.831550 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2400/4833] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:23:51 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:23:52.453040 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ea4d0022-d381-4494-8f56-6615dcecc60f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cab48b0>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:24:09.701572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:24:09.702364 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:24:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:24:09.903791 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:24:09.904487 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:24:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:24:20.198575 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:24:20.199211 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:24:20 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:24:49.842891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d7c03aaa-274d-441b-a4bf-5eeff8610b19 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 117.454545 Nov 19 20:24:49.843569 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2434/4834] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:22:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 117456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:24:49.848523 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:24:49.849177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:24:49.855240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:24:49.855694 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:24:49.856475 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:24:49.856913 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:24:49.951183 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ea4d0022-d381-4494-8f56-6615dcecc60f tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 57.502038 Nov 19 20:24:49.951751 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2401/4835] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:23:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:24:50.044971 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce68124c60ff4f6a820dc3a04630663a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6c9eacf55bb437da4631e3110651320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:24:50.053680 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ffbe3123-5c37-4375-b7b1-d51a72229fe9 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 200 len: 1369 microversion: 2.1 time: 0.209147 Nov 19 20:24:50.054298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2435/4836] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:24:49 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 1369 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:24:50.166529 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b843d5a6-fa98-4129-9013-56a4e161eead tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '.version_select at 0x7fc14cb3a820>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:24:50.192017 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b843d5a6-fa98-4129-9013-56a4e161eead tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015026434" status: 202 len: 0 microversion: 2.1 time: 0.076452 Nov 19 20:24:50.192633 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2402/4837] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Nov 19 20:24:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2015026434 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:24:51.105579 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-225940bb-96d9-4030-becc-d9153c4101a4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14ca63d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:24:51.734795 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-225940bb-96d9-4030-becc-d9153c4101a4 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 0.774324 Nov 19 20:24:51.735443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2436/4838] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:24:50 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:24:52.749198 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-139d2291-4650-4422-9b08-0c5343d9c345 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14c9cd820>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:25:33.294034 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:25:33.294622 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:25:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:25:36.851619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:25:36.852393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:25:36 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:25:52.811670 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b948b6df-937a-4ec8-bbec-f54adc6e6f31 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] Calling method '.version_select at 0x7fc14cb0edc0>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:26:04.532538 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:26:04.533159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:26:04 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a (ip 10.222.0.46) !!! Nov 19 20:26:50.301916 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-139d2291-4650-4422-9b08-0c5343d9c345 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 117.556820 Nov 19 20:26:50.302563 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2403/4839] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:24:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 117558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:26:50.449597 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b948b6df-937a-4ec8-bbec-f54adc6e6f31 tempest-VolumesSnapshotsTestJSON-238601516 tempest-VolumesSnapshotsTestJSON-238601516-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a" status: 200 len: 345 microversion: 2.1 time: 57.643899 Nov 19 20:26:50.450735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2437/4840] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Nov 19 20:25:52 2021] GET /compute/v2.1/os-volumes/f2d28ec6-409d-4fed-b8b1-0d52b48c6e9a => generated 345 bytes in 57646 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:27:29.721334 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:27:29.721998 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:27:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:27:29.926863 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:27:29.927397 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:27:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:27:40.217764 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:27:40.218513 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:27:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:28:53.315619 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:28:53.316254 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:28:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:28:56.873344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:28:56.873344 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:28:56 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:29:24.550910 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:29:24.551463 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:29:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:30:49.740303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:30:49.741231 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:30:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:30:49.951648 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:30:49.952275 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:30:49 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:31:00.241108 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:31:00.241698 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:31:00 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:31:48.524811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f1764f5f-ae10-4a30-884d-113326187a0f] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 19 20:31:48.528340 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:31:48.528858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:31:48.538321 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:48.538777 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:48.539543 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:48.539970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:48.558030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] HTTP exception thrown: Instance e9233030-c878-4eef-a231-13ba34eae0c2 could not be found. Nov 19 20:31:48.558641 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Returning 404 to user: Instance e9233030-c878-4eef-a231-13ba34eae0c2 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:31:48.559471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-29954781-d062-4027-8099-c19b2478ba88 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 404 len: 111 microversion: 2.1 time: 0.037121 Nov 19 20:31:48.559992 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2404/4841] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:31:48 2021] DELETE /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:31:48.567647 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: ERROR oslo.messaging._drivers.impl_rabbit [-] [55a27380-be4b-4b70-b3e6-9e8d488aa521] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 19 20:31:48.572741 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:31:48.573515 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: e9233030-c878-4eef-a231-13ba34eae0c2] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:31:48.586162 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:48.586766 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:48.588185 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:48.588723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:48.612086 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] HTTP exception thrown: Instance e9233030-c878-4eef-a231-13ba34eae0c2 could not be found. Nov 19 20:31:48.612708 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Returning 404 to user: Instance e9233030-c878-4eef-a231-13ba34eae0c2 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:31:48.613547 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-1823a469-5d84-4e93-bfbc-c4c6b4cb44c0 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2" status: 404 len: 111 microversion: 2.1 time: 0.048669 Nov 19 20:31:48.614133 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2438/4842] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:31:48 2021] GET /compute/v2.1/servers/e9233030-c878-4eef-a231-13ba34eae0c2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:31:53.979303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:31:53.979876 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:31:54.002535 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:54.002943 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:54.003750 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:54.004172 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:54.009873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] [f1764f5f-ae10-4a30-884d-113326187a0f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 44788. Nov 19 20:31:54.019096 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] HTTP exception thrown: Instance c95be893-491f-4bf9-aa24-491855918b26 could not be found. Nov 19 20:31:54.019668 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Returning 404 to user: Instance c95be893-491f-4bf9-aa24-491855918b26 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:31:54.020502 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5ae61bb0-a1d4-4836-8ee5-ed374930aa30 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 404 len: 111 microversion: 2.1 time: 0.047250 Nov 19 20:31:54.021054 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2405/4843] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:31:53 2021] DELETE /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:31:54.029223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:31:54.029834 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] [instance: c95be893-491f-4bf9-aa24-491855918b26] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:31:54.048369 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:54.048906 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:54.049706 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:31:54.050197 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:31:54.055368 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] [55a27380-be4b-4b70-b3e6-9e8d488aa521] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 44792. Nov 19 20:31:54.066627 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.wsgi [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] HTTP exception thrown: Instance c95be893-491f-4bf9-aa24-491855918b26 could not be found. Nov 19 20:31:54.067214 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] Returning 404 to user: Instance c95be893-491f-4bf9-aa24-491855918b26 could not be found. {{(pid=116110) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:31:54.068041 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-cd265612-80f6-4f86-b196-b3aca2f6b3a7 tempest-AttachVolumeTestJSON-2018062620 tempest-AttachVolumeTestJSON-2018062620-project] 10.222.0.46 "GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26" status: 404 len: 111 microversion: 2.1 time: 0.042565 Nov 19 20:31:54.068575 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2439/4844] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:31:54 2021] GET /compute/v2.1/servers/c95be893-491f-4bf9-aa24-491855918b26 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:32:13.335653 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:32:13.336289 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:32:13 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:32:16.892545 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:32:16.893358 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:32:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:32:30.167193 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-38440c30-e429-43e2-9626-f7f273d7d629 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Action: 'create', calling method: .version_select at 0x7fc14833d940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-845356563"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:32:30.184811 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-38440c30-e429-43e2-9626-f7f273d7d629 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Getting quotas for project f9211e4feefd4e85b5e5b0943717759b. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 20:32:30.189316 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-38440c30-e429-43e2-9626-f7f273d7d629 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Getting quotas for user 888d92d150fc4dfdbf761f2b9ef5608a and project f9211e4feefd4e85b5e5b0943717759b. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 20:32:30.548796 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-38440c30-e429-43e2-9626-f7f273d7d629 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Getting quotas for project f9211e4feefd4e85b5e5b0943717759b. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 20:32:30.553035 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.quota [None req-38440c30-e429-43e2-9626-f7f273d7d629 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Getting quotas for user 888d92d150fc4dfdbf761f2b9ef5608a and project f9211e4feefd4e85b5e5b0943717759b. Resources: {'key_pairs'} {{(pid=116111) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 20:32:30.565904 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-38440c30-e429-43e2-9626-f7f273d7d629 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.402489 Nov 19 20:32:30.566534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2406/4845] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Nov 19 20:32:30 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:30.668062 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-982674811", "imageRef": "272fd525-e795-4cb3-a516-163e3c760292", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-845356563", "networks": [{"uuid": "9f2d32a4-29ec-48b0-accb-7d3db907dce2"}]}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:32:30.887222 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.network.neutron [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] validate_networks() for [('9f2d32a4-29ec-48b0-accb-7d3db907dce2', None, None, None, None, None)] {{(pid=116110) validate_networks /opt/stack/nova/nova/network/neutron.py:2482}} Nov 19 20:32:31.437601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Flavor limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 19 20:32:31.438038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Image limits 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 19 20:32:31.438599 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Flavor pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 19 20:32:31.439036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Image pref 0:0:0 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 19 20:32:31.439333 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.virt.hardware [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=116110) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 19 20:32:31.451416 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:31.451937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:31.452704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:31.453115 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:31.472839 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Getting quotas for project f9211e4feefd4e85b5e5b0943717759b. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:387}} Nov 19 20:32:31.476811 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.quota [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Getting quotas for user 888d92d150fc4dfdbf761f2b9ef5608a and project f9211e4feefd4e85b5e5b0943717759b. Resources: {'cores', 'ram', 'instances'} {{(pid=116110) _get_quotas /opt/stack/nova/nova/quota.py:377}} Nov 19 20:32:31.488160 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Going to run 1 instances... {{(pid=116110) _provision_instances /opt/stack/nova/nova/compute/api.py:1350}} Nov 19 20:32:31.490481 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='272fd525-e795-4cb3-a516-163e3c760292',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=116110) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1757}} Nov 19 20:32:31.539043 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d12fcc2f-5a11-45a5-8bc8-eea982eb45bd tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874813 Nov 19 20:32:31.539697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2440/4846] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Nov 19 20:32:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 19 20:32:31.550941 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-74c00fee-1d23-4be9-8864-735892875bea tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:31.551465 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-74c00fee-1d23-4be9-8864-735892875bea tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:31.674415 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-74c00fee-1d23-4be9-8864-735892875bea tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:31.682327 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-74c00fee-1d23-4be9-8864-735892875bea tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1257 microversion: 2.1 time: 0.136609 Nov 19 20:32:31.682861 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2407/4847] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:31 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1257 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:32.700445 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:32.701215 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:32.709164 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:32.709450 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:32.710352 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:32.710970 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:32.802768 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:32.812330 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-70722c6b-312c-43ed-b11e-eb944e718348 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1317 microversion: 2.1 time: 0.116415 Nov 19 20:32:32.813020 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2441/4848] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:32 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1317 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:33.837857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:33.837857 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:33.841059 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:33.841503 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:33.842303 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:33.842730 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:34.032974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:34.040470 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7e3c191c-e441-4a53-90fb-7196915fa085 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.214595 Nov 19 20:32:34.041027 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2408/4849] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:33 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:35.057730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:35.058479 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:35.066616 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:35.067058 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:35.068036 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:35.068467 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:35.213891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:35.221681 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2d102e59-688d-4877-86c1-7308faf0940c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.167542 Nov 19 20:32:35.222286 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2442/4850] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:35 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:36.239296 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:36.239919 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:36.247112 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:36.248006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:36.248993 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:36.249426 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:36.473664 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:36.485915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-6624fdef-e08c-4bd3-a542-6284053c2340 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.250624 Nov 19 20:32:36.487066 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2409/4851] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:36 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:37.505458 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:37.506138 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:37.513088 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:37.513756 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:37.515073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:37.515617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:37.669762 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:37.680609 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-498f448b-e870-4e8f-8bbe-bb96e7af2829 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.179711 Nov 19 20:32:37.681444 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2443/4852] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:37 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:38.700706 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:38.701360 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:38.708877 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:38.709317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:38.710541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:38.710541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:38.855612 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:38.863189 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-2d67e0f3-4829-4cfa-aed3-73afc021ee80 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.166540 Nov 19 20:32:38.863755 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2410/4853] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:38 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:39.880193 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:39.880840 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:39.887310 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:39.887723 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:39.888494 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:39.888933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:40.030211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:40.038726 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-5d75a76e-66df-483c-a748-cecd67acd1fa tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.162214 Nov 19 20:32:40.039348 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2444/4854] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:39 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:41.060152 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:41.061067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:41.068026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:41.068481 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:41.069272 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:41.069715 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:41.213862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:41.222474 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1b3955b3-7785-429a-b249-e5ec27b23dd9 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.168256 Nov 19 20:32:41.225337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2411/4855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:41 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:42.244391 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:42.246998 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:42.257461 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:42.259891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:42.259891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:42.259891 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:42.413728 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:42.421709 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-d4731046-d33c-423a-8b76-a4aa27af5a87 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.185383 Nov 19 20:32:42.422372 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2445/4856] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:42 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:32:43.441228 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:43.442117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:43.448761 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:43.449203 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:43.450003 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:43.450461 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:43.601144 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:43.612219 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5714f1ea-06af-4a9f-942e-d112798268df tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.174868 Nov 19 20:32:43.613148 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2412/4857] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:43 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:44.570517 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:32:44.571134 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:32:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:32:44.632365 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:44.633123 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:44.640048 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:44.640576 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:44.641423 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:44.641939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:44.921374 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:44.932259 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b73d8e90-eeaf-492c-b9fd-7c090ee7db4e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.304419 Nov 19 20:32:44.933649 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2446/4858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:44 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:32:45.007458 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-0e96f463-0a56-4445-a7b0-256ce0fe74d3 req-3a533601-7f20-47bc-a0be-437885f56af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:32:45.009056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:32:45.009056 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:32:45.016938 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-0e96f463-0a56-4445-a7b0-256ce0fe74d3 req-3a533601-7f20-47bc-a0be-437885f56af4 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:45.017501 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-0e96f463-0a56-4445-a7b0-256ce0fe74d3 req-3a533601-7f20-47bc-a0be-437885f56af4 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:45.029596 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-0e96f463-0a56-4445-a7b0-256ce0fe74d3 req-3a533601-7f20-47bc-a0be-437885f56af4 service nova] Creating event network-changed:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:32:45.036229 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-0e96f463-0a56-4445-a7b0-256ce0fe74d3 req-3a533601-7f20-47bc-a0be-437885f56af4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100108 Nov 19 20:32:45.036862 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2413/4859] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:32:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:32:45.952500 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:45.953226 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:45.960213 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:45.960663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:45.961454 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:45.961888 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:46.106665 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:46.114464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c6efa5d8-f5d7-490a-807a-2ea0069f47cc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.168472 Nov 19 20:32:46.115038 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2447/4860] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:45 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:47.131487 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:47.132171 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:47.139273 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:47.139829 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:47.140723 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:47.141169 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:47.314149 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:47.322406 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-0832c2ae-ad43-4954-b0f0-0fe4b0c278bc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.194868 Nov 19 20:32:47.323337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2414/4861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:47 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:48.340833 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:48.341506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:48.349174 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:48.349658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:48.350492 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:48.350932 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:48.504857 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:48.512740 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-6870cd3a-f9ad-44ca-abe2-d398184eecfe tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.175806 Nov 19 20:32:48.513336 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2448/4862] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:48 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:49.529720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:49.530333 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:49.537341 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:49.537783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:49.538605 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:49.539032 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:49.677485 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:49.685281 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b8e79189-36e6-4010-8be4-d40fd3da3b68 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.159299 Nov 19 20:32:49.685858 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2415/4863] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:49 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:50.217967 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-403ecc75-9acd-4e3a-9538-c6a83e184e51 req-d05081b7-b15c-4b09-aba7-e7e6b0b1c2b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "name": "network-vif-plugged", "status": "completed", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:32:50.219620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:32:50.219620 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 20:32:50.227102 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-403ecc75-9acd-4e3a-9538-c6a83e184e51 req-d05081b7-b15c-4b09-aba7-e7e6b0b1c2b2 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:50.227557 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-403ecc75-9acd-4e3a-9538-c6a83e184e51 req-d05081b7-b15c-4b09-aba7-e7e6b0b1c2b2 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:50.239431 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-403ecc75-9acd-4e3a-9538-c6a83e184e51 req-d05081b7-b15c-4b09-aba7-e7e6b0b1c2b2 service nova] Creating event network-vif-plugged:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:32:50.245937 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-403ecc75-9acd-4e3a-9538-c6a83e184e51 req-d05081b7-b15c-4b09-aba7-e7e6b0b1c2b2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107848 Nov 19 20:32:50.246939 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2449/4864] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:32:50.703033 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:50.703859 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:50.712004 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:50.712752 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:50.713534 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:50.713958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:50.854792 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:50.862452 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1895b40b-fb4b-4ba7-88d9-08f350320752 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1357 microversion: 2.1 time: 0.163209 Nov 19 20:32:50.863026 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2416/4865] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:50 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:32:51.880944 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:51.881640 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:51.888894 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:51.889337 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:51.890159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:51.890594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.037191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:52.045679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-ac1ca3f0-e3bc-482d-939d-568a7f058903 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1548 microversion: 2.1 time: 0.169259 Nov 19 20:32:52.046316 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2450/4866] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:51 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:52.062812 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:52.063498 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:52.070572 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:52.071006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.071788 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:52.072235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.207863 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:52.218477 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-456aae01-816c-4859-b872-7a8336fcc982 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1548 microversion: 2.1 time: 0.159017 Nov 19 20:32:52.219225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2417/4867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:52 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:32:52.234512 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:52.237976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:32:52.237976 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 20:32:52.238984 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:52.239735 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Searching by: {'deleted': False, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b'} {{(pid=116110) get_all /opt/stack/nova/nova/compute/api.py:2907}} Nov 19 20:32:52.246965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:52.247396 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.248195 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:52.248625 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.340887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.multi_cell_list [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=116110) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 19 20:32:52.443685 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-85faee2b-5af5-4bd0-ac1f-d2b8c293efc1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212471 Nov 19 20:32:52.444508 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2451/4868] 10.222.0.46 () {58 vars in 1124 bytes} [Fri Nov 19 20:32:52 2021] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:32:52.455644 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:32:52.456288 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:52.463631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:52.464088 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.464865 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:52.465292 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:52.612206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:32:52.623278 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-f4fc4cf5-f3d9-4db1-92eb-eb54f9b84923 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1548 microversion: 2.1 time: 0.171320 Nov 19 20:32:52.623867 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2418/4869] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:32:52 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 19 20:32:54.158960 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3f8067f-040e-482e-90eb-68fb66818c38"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:32:54.160414 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:32:54.166946 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:54.167393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:54.168184 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:32:54.168613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:32:54.437613 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-93b5df71-7dd6-4931-ad09-c4fafb62086e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282784 Nov 19 20:32:54.438331 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2452/4870] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Nov 19 20:32:54 2021] POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:33:02.014724 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:02.015337 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:02.022773 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:02.023250 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:02.024052 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:02.024490 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:02.169573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:02.178307 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4deab127-2f63-4641-8eaa-1c876da6b2b4 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1594 microversion: 2.1 time: 0.167361 Nov 19 20:33:02.178903 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2419/4871] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:02 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1594 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:04.201180 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-0900695e-6986-4743-9297-27f059f17d7c req-d2e3257a-649f-4e3e-92ce-74fd347cb39f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:33:04.202974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:33:04.202974 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 20:33:04.215246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-0900695e-6986-4743-9297-27f059f17d7c req-d2e3257a-649f-4e3e-92ce-74fd347cb39f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:04.215757 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-0900695e-6986-4743-9297-27f059f17d7c req-d2e3257a-649f-4e3e-92ce-74fd347cb39f service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:04.235367 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-0900695e-6986-4743-9297-27f059f17d7c req-d2e3257a-649f-4e3e-92ce-74fd347cb39f service nova] Creating event network-changed:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:33:04.244704 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-0900695e-6986-4743-9297-27f059f17d7c req-d2e3257a-649f-4e3e-92ce-74fd347cb39f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114077 Nov 19 20:33:04.245739 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2453/4872] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:33:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:33:05.646639 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-130800215"}} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:33:05.647246 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:05.654038 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:05.654507 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:05.655311 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:05.655739 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:05.794839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.network.security_group_api [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Adding security group 5e8ed730-dc8b-4ee2-8d0a-ac8b0ac28421 to port d5f9611e-7eea-44d4-bcc7-2989b9dabdfc Nov 19 20:33:06.167383 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-4481a07d-bce4-405d-b315-270f23446ff5 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/action" status: 202 len: 0 microversion: 2.1 time: 0.524827 Nov 19 20:33:06.168216 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2420/4873] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 20:33:05 2021] POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/action => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:33:06.177731 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [req-77f516aa-67bf-43d3-a1c9-30369a755bf7 req-adb098ff-66c5-4ae9-a993-5a9904e83f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:33:06.182806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:06.183958 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:06.188240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:33:06.188240 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: warnings.warn(msg) Nov 19 20:33:06.195783 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:06.198185 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:06.199944 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:06.200378 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:06.214191 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-77f516aa-67bf-43d3-a1c9-30369a755bf7 req-adb098ff-66c5-4ae9-a993-5a9904e83f93 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:06.214405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [req-77f516aa-67bf-43d3-a1c9-30369a755bf7 req-adb098ff-66c5-4ae9-a993-5a9904e83f93 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:06.229299 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.compute.server_external_events [req-77f516aa-67bf-43d3-a1c9-30369a755bf7 req-adb098ff-66c5-4ae9-a993-5a9904e83f93 service nova] Creating event network-changed:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:33:06.235343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [req-77f516aa-67bf-43d3-a1c9-30369a755bf7 req-adb098ff-66c5-4ae9-a993-5a9904e83f93 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062441 Nov 19 20:33:06.236546 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2454/4874] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:33:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:33:06.507547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:06.517117 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-7cb91a45-5283-458c-834c-423bde6b2ab3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1759 microversion: 2.1 time: 0.337716 Nov 19 20:33:06.517600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2421/4875] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:06 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1759 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:29.145208 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:33:29.146335 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:29.153686 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:29.154290 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:29.154930 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:29.155633 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:29.237958 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-dfb83858-934c-48de-930c-399e84bbdda6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/action" status: 202 len: 0 microversion: 2.1 time: 0.097151 Nov 19 20:33:29.238617 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2455/4876] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 20:33:29 2021] POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:33:29.247562 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:29.248204 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:29.255225 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:29.255683 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:29.256602 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:29.257192 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:29.495522 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:29.504628 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-a78c92a4-cf40-4092-88e0-d272cfaeaa8b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1751 microversion: 2.1 time: 0.261693 Nov 19 20:33:29.514441 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2422/4877] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:29 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1751 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:30.526178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:30.526754 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:30.533864 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:30.534357 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:30.535132 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:30.535563 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:30.697679 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:30.707159 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-b400ef72-56be-44d6-8dfe-d2ee6fc39dcc tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.188287 Nov 19 20:33:30.707710 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2456/4878] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:30 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:31.725784 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:31.726454 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:31.733339 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:31.733779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:31.734573 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:31.735006 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:31.903034 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:31.912058 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b44f1665-d722-4d9a-935b-244b2cef15ec tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.190110 Nov 19 20:33:31.912626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2423/4879] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:31 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:32.932472 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:32.933073 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:32.941315 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:32.941761 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:32.942564 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:32.942993 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:33.108914 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:33.117223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-83b38c9e-b091-4f70-bdc3-eed039acf68b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.190545 Nov 19 20:33:33.117780 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2457/4880] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:32 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:34.137873 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:34.138536 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:34.147923 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:34.148389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:34.149565 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:34.150206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:34.305195 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:34.313444 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-55a746e5-f46f-4308-b089-fc232c93058d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.181197 Nov 19 20:33:34.314385 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2424/4881] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:34 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:35.331177 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:35.331784 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:35.338770 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:35.339211 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:35.339977 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:35.340398 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:35.499078 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:35.509802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-19b2160b-4ea3-48bd-95f4-d9c7013ca9f3 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.182342 Nov 19 20:33:35.510469 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2458/4882] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:35 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:36.530579 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:36.531127 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:36.538068 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:36.538555 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:36.539581 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:36.539718 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:36.690679 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:36.703083 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-ee09ffea-df9e-469c-a6ec-b95f2a514d90 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.177197 Nov 19 20:33:36.703985 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2425/4883] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:36 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:37.724732 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:37.725308 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:37.731966 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:37.732410 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:37.733175 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:37.733601 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:37.891658 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:37.900111 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-21bba7ff-636a-47d1-844d-60f5896b5b70 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.179369 Nov 19 20:33:37.900668 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2459/4884] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:37 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:38.918775 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:38.919397 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:38.926583 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:38.927030 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:38.927807 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:38.928209 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:39.082952 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:39.092042 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-b5abfae8-fc71-4bb9-a855-b48e98362199 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.177162 Nov 19 20:33:39.092600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2426/4885] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:38 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:40.111252 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:40.111983 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:40.118802 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:40.119241 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:40.120005 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:40.120427 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:40.284072 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:40.292253 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-7cfea58d-e158-43a8-8f7d-8b356407f626 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.184643 Nov 19 20:33:40.292838 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2460/4886] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:40 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:41.310772 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:41.311597 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:41.320067 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:41.320564 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:41.321614 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:41.322331 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:41.481629 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:41.489980 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3904e27b-afe6-4f57-89f1-a0f2429e999d tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.184174 Nov 19 20:33:41.490666 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2427/4887] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:41 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:42.508298 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:42.508872 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:42.518496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:42.519942 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:42.520935 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:42.521373 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:42.680359 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:42.688992 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-e8a0d65c-3145-448b-8232-68a47cb8dc1f tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.185078 Nov 19 20:33:42.689556 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2461/4888] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:42 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:43.708669 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:43.709315 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:43.716324 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:43.716745 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:43.717541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:43.717970 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:43.886107 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:43.894191 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-5fb397f4-90b3-42d5-9c76-b397ae1dde30 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.190456 Nov 19 20:33:43.894806 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2428/4889] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:43 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:44.915172 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:44.915850 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:44.924718 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:44.925343 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:44.926155 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:44.926586 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:45.140553 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:45.149232 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a9e8195c-89d3-45dc-8adf-8fc24b7f8fb6 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1756 microversion: 2.1 time: 0.237606 Nov 19 20:33:45.150393 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2462/4890] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:44 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:33:46.169570 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:33:46.170447 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:33:46.180227 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:46.180848 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:46.182095 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:33:46.182720 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:33:46.350585 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:33:46.360206 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-602a60a2-abe1-4806-974a-8f7a7609420b tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1759 microversion: 2.1 time: 0.196429 Nov 19 20:33:46.360779 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2429/4891] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:33:46 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1759 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:34:09.760547 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:34:09.761230 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:34:09 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:34:18.351216 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-130800215"}} {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:34:18.351985 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:18.358267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:18.358712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:18.359506 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:18.360054 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:18.505178 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.network.security_group_api [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Removing security group 5e8ed730-dc8b-4ee2-8d0a-ac8b0ac28421 from port d5f9611e-7eea-44d4-bcc7-2989b9dabdfc Nov 19 20:34:18.847978 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-87e6b980-80ae-4aa3-9ca2-bf39a367f848 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/action" status: 202 len: 0 microversion: 2.1 time: 0.501590 Nov 19 20:34:18.848696 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2463/4892] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Nov 19 20:34:18 2021] POST /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:34:18.859684 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-92e9f57b-5902-428b-9df9-19fc411b542e req-46ff74f0-a35c-48ef-b461-f5edbc5656ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:34:18.861235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:34:18.861235 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:34:18.869765 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-92e9f57b-5902-428b-9df9-19fc411b542e req-46ff74f0-a35c-48ef-b461-f5edbc5656ab service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:18.870255 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-92e9f57b-5902-428b-9df9-19fc411b542e req-46ff74f0-a35c-48ef-b461-f5edbc5656ab service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:18.889915 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-92e9f57b-5902-428b-9df9-19fc411b542e req-46ff74f0-a35c-48ef-b461-f5edbc5656ab service nova] Creating event network-changed:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:34:18.902786 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-92e9f57b-5902-428b-9df9-19fc411b542e req-46ff74f0-a35c-48ef-b461-f5edbc5656ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046769 Nov 19 20:34:18.903388 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2430/4893] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:34:19.961607 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:19.962511 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:19.969134 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:19.969585 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:19.969849 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-553bebcd-72f4-4c52-bddd-f4cfd572d08b req-6806d61b-10af-4638-a30d-af1104dbb680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:34:19.970443 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:19.970881 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:19.971909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:34:19.971909 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:34:19.979994 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-553bebcd-72f4-4c52-bddd-f4cfd572d08b req-6806d61b-10af-4638-a30d-af1104dbb680 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:19.980722 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-553bebcd-72f4-4c52-bddd-f4cfd572d08b req-6806d61b-10af-4638-a30d-af1104dbb680 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:19.994942 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-553bebcd-72f4-4c52-bddd-f4cfd572d08b req-6806d61b-10af-4638-a30d-af1104dbb680 service nova] Creating event network-changed:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:34:20.001159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-553bebcd-72f4-4c52-bddd-f4cfd572d08b req-6806d61b-10af-4638-a30d-af1104dbb680 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035416 Nov 19 20:34:20.001737 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2431/4894] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:34:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:34:20.062712 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lazy-loading 'services' on Instance uuid 99b28a57-00ab-4124-8e73-59136bb37506 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:34:20.143189 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-894b9a69-50a7-4d99-8cd4-74c0973aa723 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments/d3f8067f-040e-482e-90eb-68fb66818c38" status: 202 len: 0 microversion: 2.1 time: 0.185954 Nov 19 20:34:20.143750 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2464/4895] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 20:34:19 2021] DELETE /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments/d3f8067f-040e-482e-90eb-68fb66818c38 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:34:20.153371 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:20.154776 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:20.164787 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:20.165367 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:20.166884 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:20.169869 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:20.208631 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-1cc9c9f0-7172-48e9-aba6-2b5a39909e8c tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059216 Nov 19 20:34:20.209471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2432/4896] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:34:20 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 19 20:34:21.222384 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:21.223424 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:21.231014 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:21.231462 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:21.232266 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:21.232697 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:21.264142 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-2f7e9cd7-5d57-4c3f-8277-cea17ad2221e tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046604 Nov 19 20:34:21.264717 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2465/4897] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Nov 19 20:34:21 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 19 20:34:21.274471 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:21.274963 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:21.281317 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:21.281756 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:21.282552 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:21.282974 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:21.365442 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] HTTP exception thrown: Instance 99b28a57-00ab-4124-8e73-59136bb37506 is not attached to volume d3f8067f-040e-482e-90eb-68fb66818c38 Nov 19 20:34:21.366542 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Returning 404 to user: Instance 99b28a57-00ab-4124-8e73-59136bb37506 is not attached to volume d3f8067f-040e-482e-90eb-68fb66818c38 {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:34:21.367389 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-3cca1fc8-5ed6-474a-8cf7-982626655ace tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments/d3f8067f-040e-482e-90eb-68fb66818c38" status: 404 len: 154 microversion: 2.1 time: 0.096753 Nov 19 20:34:21.367964 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2433/4898] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Nov 19 20:34:21 2021] DELETE /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506/os-volume_attachments/d3f8067f-040e-482e-90eb-68fb66818c38 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:34:22.503464 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:22.504019 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:22.511032 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:22.511409 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:22.512168 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:22.512594 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:22.536933 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Going to try to terminate instance {{(pid=116110) delete /opt/stack/nova/nova/compute/api.py:2614}} Nov 19 20:34:22.620405 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-0843b7e7-20b1-4163-abc3-e638a89841f1 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 204 len: 0 microversion: 2.1 time: 0.120724 Nov 19 20:34:22.621018 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2466/4899] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Nov 19 20:34:22 2021] DELETE /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 19 20:34:22.628908 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:22.629651 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:22.636168 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:22.636610 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:22.637375 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:22.637802 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:22.794130 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.policy [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116111) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:34:22.802678 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-75129417-da3c-4ebc-afd4-5603cd8991d2 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1554 microversion: 2.1 time: 0.177165 Nov 19 20:34:22.803263 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2434/4900] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:34:22 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:34:23.823267 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:23.823957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:23.830460 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:23.830898 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:23.831660 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:23.832079 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:23.980867 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:34:23.989887 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-950e6bcf-f6cf-4685-90fe-4aa4286c19e0 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1554 microversion: 2.1 time: 0.170784 Nov 19 20:34:23.990509 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2467/4901] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:34:23 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:34:24.791479 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [req-b5e86f7b-9b40-412a-97a5-94ca4647ea1a req-da3989c1-1803-4766-89e4-eea298a28662 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b28a57-00ab-4124-8e73-59136bb37506", "name": "network-vif-deleted", "tag": "d5f9611e-7eea-44d4-bcc7-2989b9dabdfc"}]} {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 19 20:34:24.792959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 19 20:34:24.792959 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: warnings.warn(msg) Nov 19 20:34:24.800094 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-b5e86f7b-9b40-412a-97a5-94ca4647ea1a req-da3989c1-1803-4766-89e4-eea298a28662 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:24.800541 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [req-b5e86f7b-9b40-412a-97a5-94ca4647ea1a req-da3989c1-1803-4766-89e4-eea298a28662 service nova] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:24.812005 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.compute.server_external_events [req-b5e86f7b-9b40-412a-97a5-94ca4647ea1a req-da3989c1-1803-4766-89e4-eea298a28662 service nova] Creating event network-vif-deleted:d5f9611e-7eea-44d4-bcc7-2989b9dabdfc for instance 99b28a57-00ab-4124-8e73-59136bb37506 on hv-cinder-77703 Nov 19 20:34:24.817372 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [req-b5e86f7b-9b40-412a-97a5-94ca4647ea1a req-da3989c1-1803-4766-89e4-eea298a28662 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029411 Nov 19 20:34:24.818167 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2435/4902] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Nov 19 20:34:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 19 20:34:25.007674 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:25.008223 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.compute.api [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116110) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:25.014733 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:25.015182 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:25.015953 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:25.016362 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:25.047096 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:25.047449 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG oslo_concurrency.lockutils [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116110) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:25.047895 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.objects.instance [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lazy-loading 'fault' on Instance uuid 99b28a57-00ab-4124-8e73-59136bb37506 {{(pid=116110) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Nov 19 20:34:25.090612 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.policy [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '888d92d150fc4dfdbf761f2b9ef5608a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9211e4feefd4e85b5e5b0943717759b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=116110) authorize /opt/stack/nova/nova/policy.py:199}} Nov 19 20:34:25.098549 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-c422226e-30b5-4a08-98d4-6195d7cd5963 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 200 len: 1347 microversion: 2.1 time: 0.094908 Nov 19 20:34:25.099124 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2468/4903] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:34:25 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 1347 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 19 20:34:26.117701 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '>' {{(pid=116111) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:26.118433 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.compute.api [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] [instance: 99b28a57-00ab-4124-8e73-59136bb37506] Fetching instance by UUID {{(pid=116111) get /opt/stack/nova/nova/compute/api.py:2865}} Nov 19 20:34:26.125156 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:26.125600 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:26.126408 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 19 20:34:26.126839 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG oslo_concurrency.lockutils [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Lock "c12fc2f6-cd8d-4c14-9fdc-caa783139795" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=116111) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 19 20:34:26.140956 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.wsgi [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] HTTP exception thrown: Instance 99b28a57-00ab-4124-8e73-59136bb37506 could not be found. Nov 19 20:34:26.141539 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: DEBUG nova.api.openstack.wsgi [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Returning 404 to user: Instance 99b28a57-00ab-4124-8e73-59136bb37506 could not be found. {{(pid=116111) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Nov 19 20:34:26.142379 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO nova.api.openstack.requestlog [None req-190262bc-b8a3-419a-95fe-52ba611b6171 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506" status: 404 len: 111 microversion: 2.1 time: 0.029278 Nov 19 20:34:26.142917 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: [pid: 116111|app: 0|req: 2436/4904] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Nov 19 20:34:26 2021] GET /compute/v2.1/servers/99b28a57-00ab-4124-8e73-59136bb37506 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 19 20:34:26.152411 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: DEBUG nova.api.openstack.wsgi [None req-a8852736-4865-4ad7-adc1-7a6c4fac8659 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] Calling method '.version_select at 0x7fc14ca06d30>' {{(pid=116110) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 19 20:34:26.177595 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO nova.api.openstack.requestlog [None req-a8852736-4865-4ad7-adc1-7a6c4fac8659 tempest-TestMinimumBasicScenario-1709942987 tempest-TestMinimumBasicScenario-1709942987-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845356563" status: 202 len: 0 microversion: 2.1 time: 0.028046 Nov 19 20:34:26.178265 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: [pid: 116110|app: 0|req: 2469/4905] 10.222.0.46 () {58 vars in 1268 bytes} [Fri Nov 19 20:34:26 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-845356563 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 19 20:35:33.359957 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:35:33.360730 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:35:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:37:16.922965 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:37:16.923663 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:37:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:37:29.780417 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:37:29.781071 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:37:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:37:29.975246 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:37:29.975878 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:37:29 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:37:40.266159 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:37:40.266656 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:37:40 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:37:44.594626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:37:44.594626 dv-cinder-777031-13-iscsi devstack@n-api.service[116111]: Fri Nov 19 20:37:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Nov 19 20:38:53.380496 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 19 20:38:53.381165 dv-cinder-777031-13-iscsi devstack@n-api.service[116110]: Fri Nov 19 20:38:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!